-- Logs begin at Thu 2022-06-23 21:32:14 UTC, end at Thu 2022-06-23 22:54:33 UTC. -- Jun 23 22:27:27.989693 dv-cinder-846173-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 23 22:27:27.996973 dv-cinder-846173-2-iscsi devstack@n-api.service[103355]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 23 22:27:28.000340 dv-cinder-846173-2-iscsi devstack@n-api.service[103355]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 23 22:27:27 2022] *** Jun 23 22:27:28.000340 dv-cinder-846173-2-iscsi devstack@n-api.service[103355]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 23 22:27:28.000340 dv-cinder-846173-2-iscsi devstack@n-api.service[103355]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 23 22:27:28.000340 dv-cinder-846173-2-iscsi devstack@n-api.service[103355]: nodename: dv-cinder-846173-2-iscsi Jun 23 22:27:28.000340 dv-cinder-846173-2-iscsi devstack@n-api.service[103355]: machine: x86_64 Jun 23 22:27:28.000340 dv-cinder-846173-2-iscsi devstack@n-api.service[103355]: clock source: unix Jun 23 22:27:28.000340 dv-cinder-846173-2-iscsi devstack@n-api.service[103355]: pcre jit disabled Jun 23 22:27:28.000340 dv-cinder-846173-2-iscsi devstack@n-api.service[103355]: detected number of CPU cores: 4 Jun 23 22:27:28.000340 dv-cinder-846173-2-iscsi devstack@n-api.service[103355]: current working directory: / Jun 23 22:27:28.000340 dv-cinder-846173-2-iscsi devstack@n-api.service[103355]: detected binary path: /usr/bin/uwsgi-core Jun 23 22:27:28.000340 dv-cinder-846173-2-iscsi devstack@n-api.service[103355]: your processes number limit is 47680 Jun 23 22:27:28.000340 dv-cinder-846173-2-iscsi devstack@n-api.service[103355]: your memory page size is 4096 bytes Jun 23 22:27:28.000340 dv-cinder-846173-2-iscsi devstack@n-api.service[103355]: detected max file descriptor number: 2048 Jun 23 22:27:28.000340 dv-cinder-846173-2-iscsi devstack@n-api.service[103355]: lock engine: pthread robust mutexes Jun 23 22:27:28.000340 dv-cinder-846173-2-iscsi devstack@n-api.service[103355]: thunder lock: enabled Jun 23 22:27:28.001227 dv-cinder-846173-2-iscsi devstack@n-api.service[103355]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 23 22:27:28.001227 dv-cinder-846173-2-iscsi devstack@n-api.service[103355]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 23 22:27:28.043929 dv-cinder-846173-2-iscsi devstack@n-api.service[103355]: Python main interpreter initialized at 0x561130a7d9c0 Jun 23 22:27:28.043929 dv-cinder-846173-2-iscsi devstack@n-api.service[103355]: python threads support enabled Jun 23 22:27:28.043929 dv-cinder-846173-2-iscsi devstack@n-api.service[103355]: your server socket listen backlog is limited to 100 connections Jun 23 22:27:28.043929 dv-cinder-846173-2-iscsi devstack@n-api.service[103355]: your mercy for graceful operations on workers is 90 seconds Jun 23 22:27:28.044311 dv-cinder-846173-2-iscsi devstack@n-api.service[103355]: mapped 403077 bytes (393 KB) for 2 cores Jun 23 22:27:28.044388 dv-cinder-846173-2-iscsi devstack@n-api.service[103355]: *** Operational MODE: preforking *** Jun 23 22:27:28.044597 dv-cinder-846173-2-iscsi devstack@n-api.service[103355]: *** uWSGI is running in multiple interpreter mode *** Jun 23 22:27:28.044597 dv-cinder-846173-2-iscsi devstack@n-api.service[103355]: spawned uWSGI master process (pid: 103355) Jun 23 22:27:28.044802 dv-cinder-846173-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 23 22:27:28.045484 dv-cinder-846173-2-iscsi devstack@n-api.service[103355]: spawned uWSGI worker 1 (pid: 103356, cores: 1) Jun 23 22:27:28.045819 dv-cinder-846173-2-iscsi devstack@n-api.service[103355]: spawned uWSGI worker 2 (pid: 103357, cores: 1) Jun 23 22:27:28.045819 dv-cinder-846173-2-iscsi devstack@n-api.service[103355]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 23 22:27:28.702211 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 22:27:28.707406 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 22:27:29.838348 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 22:27:29.838348 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: from cryptography.utils import int_from_bytes Jun 23 22:27:29.839041 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 22:27:29.839041 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: from cryptography.utils import int_from_bytes Jun 23 22:27:29.844346 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 22:27:29.844346 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: from cryptography.utils import int_from_bytes Jun 23 22:27:29.844787 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 22:27:29.844787 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: from cryptography.utils import int_from_bytes Jun 23 22:27:32.337268 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 22:27:32.337829 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 22:27:32.338025 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 22:27:32.338379 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 22:27:32.338630 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 22:27:32.339043 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.339368 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.339519 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 22:27:32.339881 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.339972 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 22:27:32.340057 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.340293 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 22:27:32.340387 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.340594 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.340691 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 22:27:32.340902 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 22:27:32.340996 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.341213 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.341298 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.341533 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.341627 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.341789 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.341916 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.342096 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.342240 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.342413 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846173-2-iscsi {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.342574 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.342728 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.342887 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.343057 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.343237 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.343402 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.343559 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.343653 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.343887 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.343968 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.344150 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.344248 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.344469 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.344600 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.344796 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846173-2-iscsi {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.345018 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.345416 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.345416 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.345655 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.345778 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.345885 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.346022 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.346155 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.346338 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.346460 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.346644 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.346729 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.346963 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.347097 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.347282 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.348142 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.348254 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.348465 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.348565 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.348776 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.348875 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.349091 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.349188 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846173-2-iscsi {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.349430 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.349515 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.349747 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.349878 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.350061 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.350159 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.350385 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.350524 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.350697 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.350827 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.351048 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.351146 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.351363 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.351448 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.351691 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.351790 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846173-2-iscsi {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.351995 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.352084 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.352314 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.352404 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.352627 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.352721 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.352939 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.353073 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.353253 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.353389 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.353549 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.353702 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.353851 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.354025 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.354157 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.354357 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.354468 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.354669 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.354755 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.355030 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.355126 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.355314 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.355415 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.355616 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.355713 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.355929 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.356022 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.356241 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.356333 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.356552 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.356649 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.356792 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.356879 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.357035 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.357162 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.357345 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.357467 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.357657 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.357770 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.357959 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.358044 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.358260 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.358357 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.358563 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.358648 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.358865 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.358964 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.359198 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.359285 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.359500 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.359586 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.359747 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.359832 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.360068 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.360161 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.360390 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.360483 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.360699 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.360791 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.361006 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.361090 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.361307 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.361390 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.361615 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.361707 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.361923 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.362057 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.362230 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.362317 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.362529 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.362633 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.362837 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.362942 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.363215 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.363343 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.363515 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.363611 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.363862 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.364004 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.364133 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.364219 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.364435 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.364523 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.364733 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.364840 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.365039 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.365124 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.365353 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.365478 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.365678 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.365762 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.365978 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.366063 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.366223 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.366310 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.366518 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.366668 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.366815 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.366957 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.367155 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.367267 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.367471 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.367558 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.367748 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.367871 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.368049 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.368201 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.368344 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.368535 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.368644 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.369055 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.369283 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.369379 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.369544 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.369641 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.369853 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.370015 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.370164 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.370250 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.370490 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.370575 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.370796 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.371121 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.371437 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.371521 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.371752 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.371838 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.372055 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.372150 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.372358 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.372443 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.372660 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.372754 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.372960 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.373058 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.373273 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.373357 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.373574 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.373659 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.373874 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.373968 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.374188 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.374279 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.374489 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.374581 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.374789 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.374984 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.375128 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.375214 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.375429 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.375514 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.375773 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.375865 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.376039 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.376132 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.376332 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.376416 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.376631 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.376763 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.376941 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.377036 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.377243 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.377338 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.377542 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.377629 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.377840 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.377924 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.378138 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.378234 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.378436 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.378522 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.379267 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.379366 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.379572 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.379669 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.379871 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.379965 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.380163 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.380249 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.380476 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.380601 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.380796 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.380897 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.381100 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.381194 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.381402 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.381498 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.381704 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.381803 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.382011 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.382102 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.382321 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.382418 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.382630 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.382722 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.382959 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.383054 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.383273 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.383372 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.383584 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.383669 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.383893 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.383978 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.384198 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.384296 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.384508 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.384591 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.384841 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.384985 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.385132 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.385228 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.385435 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.385519 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.385744 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.385835 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.386047 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.386139 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:27:32.386361 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.386446 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.386675 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.386759 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.387021 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.387113 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.387335 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.387433 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.387647 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.387742 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.387961 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.388047 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.388266 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.388357 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.388576 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.388671 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.388895 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.388990 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.389214 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.389365 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.389519 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.389661 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.389851 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.389938 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.390168 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.390254 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.390480 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.390577 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.390798 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.390883 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.391140 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.391230 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.391447 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.391614 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.391754 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.391841 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.392058 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.392143 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.392373 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.392468 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.392692 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.392776 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.392996 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.393087 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.393308 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.393396 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.393616 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.393708 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.393923 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.394015 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.394228 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.394423 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.395124 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.395227 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.395437 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.395523 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.395774 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.395862 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.396085 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.396178 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.396395 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.396482 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.396704 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.396790 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.397015 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.397101 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.397322 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.397422 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.397628 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.397721 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.397933 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.398019 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.398231 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.398329 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.398529 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.398615 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.398825 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.398911 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.399154 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.399255 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.399452 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.399540 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.399764 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.399859 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.400084 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.400184 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.400385 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.400471 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.400709 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.400795 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.401008 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.401095 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.401311 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.401397 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.401615 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.401700 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.401916 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.402002 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.402214 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.402543 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.402773 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.402870 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.403104 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.403193 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.403405 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.403491 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.403709 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.403801 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.404013 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.404098 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.404313 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.404399 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.404632 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.404728 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.404933 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.405026 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.405233 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.405318 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.405546 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.405640 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.405854 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.405940 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.406161 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.406246 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.406464 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.406558 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.406768 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.406853 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.407103 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.407250 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.407411 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.407507 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.407719 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.407806 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.408043 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.408134 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.408343 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.408430 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.408649 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.408733 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.408968 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.409042 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.409276 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.409352 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.409587 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.409662 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.409888 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.410048 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.410270 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.410348 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.410579 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.410687 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.410876 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.410984 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.411203 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.411291 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.411510 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.411595 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.411810 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.411904 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.412109 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.412196 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.412409 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.412495 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.412709 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.412804 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.413008 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.413094 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.413325 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.413411 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.413630 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.413733 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.413930 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.414023 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.414228 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.414322 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.414528 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.414624 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.414865 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.414972 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.415190 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.415332 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.415530 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.415618 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.415839 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.415932 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.416150 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.416235 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.416459 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.416546 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.416764 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.416858 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.417067 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.417198 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.417372 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.417467 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.417679 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.417765 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.417983 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.418067 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.418313 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.418405 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.418588 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.418681 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.418890 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.419025 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.419226 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.419314 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.419530 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.419616 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.419846 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.419941 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.420151 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.420299 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.420465 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.420560 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.420763 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.420927 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.421072 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.421165 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.421404 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.421497 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.421729 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.421823 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.422038 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.422122 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.422347 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.422439 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.422650 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.422749 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.422986 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.423078 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.423295 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.423382 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.423599 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.423687 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.423904 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.423990 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.424210 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.424296 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.424523 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.424617 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.424826 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.424911 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.425134 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.425219 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.425444 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.425539 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.425853 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.426056 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.426137 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.426216 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.426417 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.426515 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.426717 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.426811 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.427051 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.427142 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.427371 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.427459 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.427687 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.427775 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.427989 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.428084 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.428295 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.428389 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.428611 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.428704 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.428916 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.429015 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.429220 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.429307 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.429526 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.429621 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.429828 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.429923 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.430128 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.430222 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.430433 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.430520 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.430744 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.430838 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.431070 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.431171 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.431378 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.431464 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.431678 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.431765 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.431986 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.432072 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.432288 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.432381 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.432586 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.432674 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.432884 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.433019 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.433190 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.433279 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.433505 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.433601 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.433811 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.433904 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.434116 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.434210 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.434427 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.434513 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.434725 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.434817 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.435046 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.435149 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.435361 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.435446 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.435663 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.435749 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.435962 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.436062 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.436262 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.436356 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.436559 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.436652 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.436861 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.436958 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.437176 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.437262 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.437472 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.437557 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.437782 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.437877 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.438098 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.438184 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.438402 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.438489 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.438709 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.438794 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.439034 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.439123 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.439341 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.439427 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.439654 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.439750 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.439958 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.440043 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.440258 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.440343 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.440561 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.440648 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.440863 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.440960 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.441168 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.441864 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.442086 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.442179 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.442411 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.442575 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.442722 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.442911 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.443064 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.443253 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.443340 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.443576 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.443664 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.443894 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.443982 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.444210 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.444295 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.444536 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.444798 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.444898 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.445130 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.445217 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.445448 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.445538 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.445761 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.445856 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.446075 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.446161 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.446387 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.446473 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.446710 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.446796 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.447051 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.447153 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.447370 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.447496 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.447680 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.447775 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.447983 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.448071 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.448281 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.448373 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.448581 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.448677 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.448887 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.449156 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.449243 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.449471 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.449557 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.449769 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.449863 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.450071 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.450156 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.450369 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.450457 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.450666 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.450753 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.450986 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.451075 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.451285 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.451402 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.451593 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.451749 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.451891 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.452060 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.452196 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.452376 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.452493 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.452685 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.452808 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.452993 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.453111 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.453306 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.453400 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.453615 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.453700 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.453924 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.454010 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.454232 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.454326 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.454546 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.454633 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.454855 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.454991 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.455191 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.455291 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.455498 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.455585 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.455807 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.455893 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.456127 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.456222 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.456437 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.456529 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.456734 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.456908 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.457136 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.457226 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.457666 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.457777 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.457989 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.458088 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.458301 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.458390 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.458614 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.458707 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.458941 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.459032 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.459295 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.459391 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.459601 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.459699 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.459910 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.460004 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.460213 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.460350 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.460519 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.460607 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.460818 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.460914 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.461129 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.461226 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.461436 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.461522 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.461736 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.461830 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.462034 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.462120 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.462340 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.462426 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.462645 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.462741 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.462959 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.463050 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.463269 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.463356 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.463570 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.463674 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.463883 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.463979 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.464182 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.464267 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.464481 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.464575 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.464780 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.464867 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.465090 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.465175 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.465395 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.465480 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.465696 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.465783 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.466005 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.466090 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.466310 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.466397 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.466607 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.466693 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.466908 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.467041 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.467235 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.467323 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.467536 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.467631 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.467836 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.467936 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.468139 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.468240 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.468456 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.468555 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.468758 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.468857 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.469055 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.469140 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.469359 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.469445 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.469656 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.469754 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.469954 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.470042 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.470252 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.470339 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.470555 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.470651 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.470854 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.470972 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.471195 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.471291 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.471491 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.471584 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.471790 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.471877 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.472089 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.472175 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.472393 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.473022 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.473228 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.473425 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.473513 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.473813 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.473908 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.474112 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.474199 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.474451 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.474538 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.474750 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.474951 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.475099 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.475185 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.475411 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.475497 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.475720 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.475808 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.476031 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.476127 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.476333 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.476420 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.476637 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.476730 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.476941 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.477039 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.477237 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.477322 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.477540 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.477633 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.477843 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.477928 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.478149 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.478235 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.478446 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.478533 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.478742 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.478828 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.479072 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.479174 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.479378 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.479464 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.479685 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.479778 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.479998 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.480094 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.480312 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.480398 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.480627 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.480716 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.480924 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.481020 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.481228 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.481314 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.481534 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.481620 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.481837 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.481933 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.482141 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.482227 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.482446 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.482540 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.482754 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.482849 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.483085 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.483176 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.483391 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.483522 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.483698 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.483786 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.484000 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.484086 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.484302 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.484395 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.484605 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.484693 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.484911 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.484998 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.485210 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.485297 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.485537 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.485624 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.485839 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.485923 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.486138 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.486224 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.486442 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.486537 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.486743 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.486836 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.487073 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.487183 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.487373 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.487461 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.487687 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.487800 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.488004 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.488207 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.488973 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.489070 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.489331 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.489447 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.489641 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.489771 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.489950 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.490091 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.490264 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.490409 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.490573 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.490727 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.490874 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.491071 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.491310 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.491397 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.491618 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.491705 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.491928 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.492015 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.492236 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.492331 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.492539 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.492640 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.492838 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.492924 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.493143 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.493230 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.493461 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.493594 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.493762 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.493907 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.494059 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.494225 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.494359 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.494536 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.494677 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.494852 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.495003 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.495198 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.495321 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.495519 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.495735 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.495821 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.496043 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.496183 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.496344 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.496538 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.496755 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.496878 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.497065 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.497161 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.497372 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.497467 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.497689 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.497783 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.498006 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.498105 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.498325 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.498413 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.498628 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.498721 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.498958 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.499081 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.499270 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.499368 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.499579 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.499675 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.499895 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.499990 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.500203 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.500298 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.500515 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.500610 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.500817 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.500917 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.501135 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.501312 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.501452 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.501540 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.501760 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.501930 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.502076 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.502245 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.502483 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.502570 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.502800 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.502886 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.503133 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.503221 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.503453 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.503548 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.503843 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.504016 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.504171 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.504303 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.504474 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.504621 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.504780 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.504950 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.505082 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.505280 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.505387 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.505598 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.505707 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.505918 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.506006 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.506226 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.506312 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.506555 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.506642 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.506881 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.507000 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.507204 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.507353 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.507504 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.507602 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.507822 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.507917 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.508125 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.508232 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.508444 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.508546 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.508752 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.508843 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.509069 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.509160 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.509384 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.509483 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.509685 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.509776 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.510002 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.510101 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.510306 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.510408 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.510606 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.510696 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.510906 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.511008 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.511227 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.511323 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.511565 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.511653 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.511865 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.511960 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.512179 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.512265 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.512487 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.512573 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.512795 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.512881 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.513100 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.513186 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.513410 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.513495 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.513734 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.513820 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.514045 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.514132 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.514358 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.514444 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.514677 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.514840 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.515004 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.515094 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.515305 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.515401 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.515614 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.515709 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.515913 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.516009 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.516212 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.516339 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.516510 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.516605 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.516813 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.516899 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.517108 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.517195 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.517404 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.517499 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.517700 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.517788 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.518014 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.518101 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.518312 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.518413 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.518628 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.518722 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.518975 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.519067 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.519254 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.519388 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.519577 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.519679 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.519876 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.520110 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.520210 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.520428 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.520516 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.520739 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.520834 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.521055 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.521143 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.521364 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.521451 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.521673 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.521761 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.521981 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.522070 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.522296 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.522384 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.522601 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.522695 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.522907 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.523015 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.523235 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.523323 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.523546 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.523632 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.523856 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.523943 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.524165 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.524250 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.524475 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.524562 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.524782 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.524868 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.525091 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.525178 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.525401 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.525497 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.525712 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.525798 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.526040 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.526238 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.526374 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.526562 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.526696 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.526871 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.527043 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.527217 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.527630 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.527777 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.527945 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.528087 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.528274 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.528397 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.528596 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.528693 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.528917 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.529003 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.529236 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.529322 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.529556 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.529645 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.529879 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.529966 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.530193 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.530286 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.530511 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.530600 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.530825 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.530936 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.531164 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.531251 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.531473 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.531562 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.531784 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.531872 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.532093 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.532313 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.532443 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.532648 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.532743 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.532969 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.533057 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.533287 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.533375 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.533604 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.533698 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.533923 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.534020 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.534230 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.534315 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.534537 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.534624 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.534847 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.535504 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.535749 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.535838 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.536067 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.536180 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.536377 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.536517 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.536687 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.536845 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.536997 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.537176 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.537318 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.537515 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.537647 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.537839 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.537963 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.538159 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.538301 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.538479 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.538568 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.538797 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.538884 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.539181 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.539394 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.539503 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.539704 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.539798 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.540031 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.540128 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.540350 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.540437 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.540670 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.540757 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.540985 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.541084 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.541298 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.541385 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.541621 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.541708 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.541923 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.542018 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.542224 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.542311 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.542530 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.542616 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.542836 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.542942 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.543162 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.543251 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.543481 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.543574 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.543789 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.543877 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.544088 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.544183 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.544405 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.544492 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.544710 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.544806 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.545022 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.545238 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.545551 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.545638 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.545875 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.545964 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.546195 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.546281 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.546515 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.546612 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.546829 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.546916 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.547157 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.547244 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.547477 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.547577 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.547780 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.547867 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.548081 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.548166 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.548393 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.548527 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.548697 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.548790 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.548996 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.549083 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.549295 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.549390 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.549602 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.549689 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.549905 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.549998 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.550203 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.550291 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.550507 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.550669 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.550900 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.551052 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.551414 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.551501 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.551723 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.551817 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.552027 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.552120 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.552328 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.552416 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.552640 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.552727 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.552943 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.553038 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.553243 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.553336 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.553544 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.553631 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.553844 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.553939 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.554153 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.554240 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.554453 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.554541 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.554759 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.554855 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.555094 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.555193 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.555404 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.555492 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.555701 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.555797 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.556012 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.556105 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.556315 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.556400 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.556629 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.556768 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.556938 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.557025 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.557239 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.557324 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.557551 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.557646 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.557853 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.557939 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.558160 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.558253 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.558465 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.558587 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.558769 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.558863 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.559101 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.559200 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.559409 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.559496 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.559715 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.559944 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.560031 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.560274 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.560374 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.560592 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.560679 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.560912 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.560997 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.561227 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.561321 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.561528 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.561613 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.561830 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.561916 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.562133 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.562220 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.562455 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.562541 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.562762 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.562849 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.563093 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.563183 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.563398 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.563484 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.563707 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.563822 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.564015 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.564119 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.564319 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.564408 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.564626 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.564722 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.564932 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.565019 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.565238 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.565325 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.565542 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.565797 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.565884 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.566133 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.566742 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.566977 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.567094 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.567298 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.567427 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.567624 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.567756 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.567937 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.568036 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.568252 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.568346 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.568563 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.568687 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.568876 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.568977 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.569182 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.569276 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.569487 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.569574 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.569791 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.569886 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.570096 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.570184 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.570408 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.570494 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.570731 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.570827 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.571063 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.571154 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.571368 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.571454 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.571742 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.571833 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.572054 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.572142 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.572366 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.572455 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.572677 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.572765 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.572980 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.573066 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.573294 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.573392 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.573611 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.573698 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.573919 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.574007 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.574235 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.574399 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.574542 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.574636 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.574859 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.574966 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.575200 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.575300 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.575513 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.575600 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.575824 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.575912 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.576121 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.576215 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.576427 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.576514 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.576725 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.576814 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.577028 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.577123 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.577341 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.577429 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.577643 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.577756 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.577942 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.578072 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.578239 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.578395 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.578542 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.578721 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.578855 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.579059 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.579150 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.579384 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.579471 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.579709 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.579798 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.580010 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.580108 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.580307 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.580394 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.580604 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.580692 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.580900 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.580985 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.581196 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.581283 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.581492 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.581580 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.581788 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.581977 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.582129 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.582246 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.582436 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.582556 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.582730 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.582827 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.583053 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.583157 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.583355 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.583466 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.583653 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.583779 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.583980 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.584077 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.584309 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.584398 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.584621 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.584708 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.584938 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.585035 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.585247 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.585335 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.585546 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.585634 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.585851 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.585939 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.586162 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.586249 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.586464 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.586550 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.586767 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.586855 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.587097 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.587195 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.587407 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.587501 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.587712 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.587812 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.588017 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.588112 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.588324 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.588412 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.588626 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.588713 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.588935 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.589060 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.589233 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.589350 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.589540 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.589637 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.589844 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.589940 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.590142 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.590246 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.590461 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.590557 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.590776 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.590879 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.591118 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.591228 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.591431 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.591535 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.591742 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.591847 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.592052 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.592147 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.592360 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.592448 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.592667 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.592756 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.592982 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.593086 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.593291 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.593385 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.593597 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.593701 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.593910 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.594006 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.594220 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.594315 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.594531 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.594625 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.594844 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.594960 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.595177 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.595271 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.595485 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.595593 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.595805 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.595900 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.596132 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.596235 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.596441 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.596544 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.596768 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.596863 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.597090 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.597192 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.597401 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.598057 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.598234 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.598364 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.598593 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.598681 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.598853 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103356) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 22:27:32.599045 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.599250 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.599566 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.599888 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.600202 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.600518 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.600841 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.601161 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.601496 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.601825 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.602138 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.602465 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.602794 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.603240 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.603559 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.603904 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.604237 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.604555 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.604870 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.605180 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:27:32.605425 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 22:27:32.752083 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO dbcounter [None req-144f2d4d-c909-4c1f-9af3-c0a2ed620775 None None] Registered counter for database nova_api Jun 23 22:27:32.758172 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO dbcounter [None req-588b6cdc-a256-49ca-baa2-ed688b19710b None None] Registered counter for database nova_api Jun 23 22:27:32.774416 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG oslo_db.sqlalchemy.engines [None req-144f2d4d-c909-4c1f-9af3-c0a2ed620775 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103356) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 22:27:32.778520 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG oslo_db.sqlalchemy.engines [None req-588b6cdc-a256-49ca-baa2-ed688b19710b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103357) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 22:27:32.781320 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG dbcounter [-] [103356] Writer thread running {{(pid=103356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 22:27:32.784906 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG dbcounter [-] [103357] Writer thread running {{(pid=103357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 22:27:32.839046 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.context [None req-144f2d4d-c909-4c1f-9af3-c0a2ed620775 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),153e4b5e-85be-4e7e-b870-de4fc67764a6(cell1) {{(pid=103356) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 22:27:32.843022 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG oslo_concurrency.lockutils [None req-144f2d4d-c909-4c1f-9af3-c0a2ed620775 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:27:32.843192 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.context [None req-588b6cdc-a256-49ca-baa2-ed688b19710b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),153e4b5e-85be-4e7e-b870-de4fc67764a6(cell1) {{(pid=103357) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 22:27:32.844620 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG oslo_concurrency.lockutils [None req-144f2d4d-c909-4c1f-9af3-c0a2ed620775 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:27:32.845413 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG oslo_concurrency.lockutils [None req-144f2d4d-c909-4c1f-9af3-c0a2ed620775 None None] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:27:32.847145 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG oslo_concurrency.lockutils [None req-588b6cdc-a256-49ca-baa2-ed688b19710b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:27:32.847397 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG oslo_concurrency.lockutils [None req-144f2d4d-c909-4c1f-9af3-c0a2ed620775 None None] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103356) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:27:32.849551 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG oslo_concurrency.lockutils [None req-588b6cdc-a256-49ca-baa2-ed688b19710b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:27:32.850016 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO dbcounter [None req-144f2d4d-c909-4c1f-9af3-c0a2ed620775 None None] Registered counter for database nova_cell0 Jun 23 22:27:32.850340 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG oslo_concurrency.lockutils [None req-588b6cdc-a256-49ca-baa2-ed688b19710b None None] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:27:32.852339 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG oslo_concurrency.lockutils [None req-588b6cdc-a256-49ca-baa2-ed688b19710b None None] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:27:32.854160 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO dbcounter [None req-144f2d4d-c909-4c1f-9af3-c0a2ed620775 None None] Registered counter for database nova_cell1 Jun 23 22:27:32.854320 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO dbcounter [None req-588b6cdc-a256-49ca-baa2-ed688b19710b None None] Registered counter for database nova_cell0 Jun 23 22:27:32.858364 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO dbcounter [None req-588b6cdc-a256-49ca-baa2-ed688b19710b None None] Registered counter for database nova_cell1 Jun 23 22:27:32.862805 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG oslo_db.sqlalchemy.engines [None req-144f2d4d-c909-4c1f-9af3-c0a2ed620775 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103356) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 22:27:32.864073 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG oslo_db.sqlalchemy.engines [None req-144f2d4d-c909-4c1f-9af3-c0a2ed620775 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103356) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 22:27:32.865600 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG oslo_db.sqlalchemy.engines [None req-588b6cdc-a256-49ca-baa2-ed688b19710b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103357) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 22:27:32.870567 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG dbcounter [-] [103357] Writer thread running {{(pid=103357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 22:27:32.870816 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG dbcounter [-] [103356] Writer thread running {{(pid=103356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 22:27:32.871245 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG oslo_db.sqlalchemy.engines [None req-588b6cdc-a256-49ca-baa2-ed688b19710b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103357) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 22:27:32.875702 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG dbcounter [-] [103356] Writer thread running {{(pid=103356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 22:27:33.012530 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG dbcounter [-] [103357] Writer thread running {{(pid=103357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 22:27:33.017680 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO dbcounter [None req-144f2d4d-c909-4c1f-9af3-c0a2ed620775 None None] Registered counter for database nova_cell0 Jun 23 22:27:33.021586 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO dbcounter [None req-588b6cdc-a256-49ca-baa2-ed688b19710b None None] Registered counter for database nova_cell0 Jun 23 22:27:33.025725 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG oslo_db.sqlalchemy.engines [None req-144f2d4d-c909-4c1f-9af3-c0a2ed620775 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103356) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 22:27:33.030424 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG dbcounter [-] [103356] Writer thread running {{(pid=103356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 22:27:33.031730 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG oslo_db.sqlalchemy.engines [None req-588b6cdc-a256-49ca-baa2-ed688b19710b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103357) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 22:27:33.036705 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG dbcounter [-] [103357] Writer thread running {{(pid=103357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 22:27:33.367590 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: WARNING keystonemiddleware.auth_token [None req-588b6cdc-a256-49ca-baa2-ed688b19710b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 22:27:33.368950 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: WARNING keystonemiddleware.auth_token [None req-144f2d4d-c909-4c1f-9af3-c0a2ed620775 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 22:27:33.374672 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: WARNING keystonemiddleware.auth_token [None req-588b6cdc-a256-49ca-baa2-ed688b19710b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 22:27:33.376485 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: WARNING keystonemiddleware.auth_token [None req-144f2d4d-c909-4c1f-9af3-c0a2ed620775 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 22:27:33.714267 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: WARNING keystonemiddleware.auth_token [None req-588b6cdc-a256-49ca-baa2-ed688b19710b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 22:27:33.720096 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: WARNING keystonemiddleware.auth_token [None req-588b6cdc-a256-49ca-baa2-ed688b19710b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 22:27:33.724141 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: WARNING keystonemiddleware.auth_token [None req-144f2d4d-c909-4c1f-9af3-c0a2ed620775 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 22:27:33.725585 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561130a7d9c0 pid: 103357 (default app) Jun 23 22:27:33.727648 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-588b6cdc-a256-49ca-baa2-ed688b19710b None None] Calling method '>' {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:27:33.728819 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.requestlog [None req-588b6cdc-a256-49ca-baa2-ed688b19710b None None] 10.222.0.43 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001726 Jun 23 22:27:33.729224 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: [pid: 103357|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 788 bytes} [Thu Jun 23 22:27:33 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:27:33.730206 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: WARNING keystonemiddleware.auth_token [None req-144f2d4d-c909-4c1f-9af3-c0a2ed620775 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 22:27:33.735481 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561130a7d9c0 pid: 103356 (default app) Jun 23 22:28:49.250513 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-588b6cdc-a256-49ca-baa2-ed688b19710b None None] Calling method '>' {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:28:49.251551 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.requestlog [None req-588b6cdc-a256-49ca-baa2-ed688b19710b None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jun 23 22:28:49.251950 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: [pid: 103357|app: 0|req: 2/2] 10.222.0.43 () {54 vars in 930 bytes} [Thu Jun 23 22:28:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:28:49.264420 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG dbcounter [-] [103356] Writing DB stats nova_api:SELECT=3 {{(pid=103356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:28:49.265335 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG dbcounter [-] [103356] Writing DB stats nova_cell1:SELECT=3 {{(pid=103356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:28:49.266540 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG dbcounter [-] [103356] Writing DB stats nova_cell0:SELECT=3 {{(pid=103356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:28:49.267660 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG dbcounter [-] [103356] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:28:49.720613 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-e937e5d2-81e2-498c-9c6f-f1ca88dc10b0 admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:28:49.753013 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-e937e5d2-81e2-498c-9c6f-f1ca88dc10b0 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.493861 Jun 23 22:28:49.754869 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 1/3] 10.222.0.43 () {60 vars in 1291 bytes} [Thu Jun 23 22:28:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:28:51.850347 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-588b6cdc-a256-49ca-baa2-ed688b19710b None None] Calling method '>' {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:28:51.851370 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.requestlog [None req-588b6cdc-a256-49ca-baa2-ed688b19710b None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jun 23 22:28:51.851754 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: [pid: 103357|app: 0|req: 3/4] 10.222.0.43 () {54 vars in 930 bytes} [Thu Jun 23 22:28:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:28:51.916100 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-b3b24afb-2001-42a4-b9ba-a774035ea1ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "ram": 256, "rxtx_factor": 1.0, "name": "cirros256", "disk": 1, "swap": 0, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:28:51.935435 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 22:28:51.935435 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: warnings.warn(msg) Jun 23 22:28:51.968310 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-b3b24afb-2001-42a4-b9ba-a774035ea1ec admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.110032 Jun 23 22:28:51.968872 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 2/5] 10.222.0.43 () {64 vars in 1282 bytes} [Thu Jun 23 22:28:51 2022] POST /compute/v2.1/flavors => generated 407 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 22:28:51.986064 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG dbcounter [-] [103357] Writing DB stats nova_api:SELECT=3 {{(pid=103357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:28:51.986877 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG dbcounter [-] [103357] Writing DB stats nova_cell0:SELECT=3 {{(pid=103357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:28:51.988164 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG dbcounter [-] [103357] Writing DB stats nova_cell1:SELECT=3 {{(pid=103357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:28:51.988896 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG dbcounter [-] [103357] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:28:52.198436 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-efd8ac0f-5e8b-4785-951d-18792dcaf18b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:28:52.200874 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 22:28:52.200874 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: warnings.warn(msg) Jun 23 22:28:52.265732 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.requestlog [None req-efd8ac0f-5e8b-4785-951d-18792dcaf18b admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284718 Jun 23 22:28:52.266650 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: [pid: 103357|app: 0|req: 4/6] 10.222.0.43 () {64 vars in 1335 bytes} [Thu Jun 23 22:28:51 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:28:54.416395 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-b3b24afb-2001-42a4-b9ba-a774035ea1ec admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:28:54.417412 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-b3b24afb-2001-42a4-b9ba-a774035ea1ec admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jun 23 22:28:54.417805 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 3/7] 10.222.0.43 () {54 vars in 930 bytes} [Thu Jun 23 22:28:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:28:54.523643 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-6812f1d9-05af-48e4-886d-3949d6cfcddc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "vcpus": 1, "rxtx_factor": 1.0, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "ram": 512, "id": "d1"}} {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:28:54.542356 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 22:28:54.542356 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: warnings.warn(msg) Jun 23 22:28:54.561179 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.requestlog [None req-6812f1d9-05af-48e4-886d-3949d6cfcddc admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.137461 Jun 23 22:28:54.561914 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: [pid: 103357|app: 0|req: 5/8] 10.222.0.43 () {64 vars in 1282 bytes} [Thu Jun 23 22:28:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 22:28:54.573971 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-ab6bab9e-2e47-45e2-ae31-836e5d779f66 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:28:54.575571 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 22:28:54.575571 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: warnings.warn(msg) Jun 23 22:28:54.610734 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-ab6bab9e-2e47-45e2-ae31-836e5d779f66 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040374 Jun 23 22:28:54.611339 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 4/9] 10.222.0.43 () {64 vars in 1335 bytes} [Thu Jun 23 22:28:54 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:28:56.723135 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-6812f1d9-05af-48e4-886d-3949d6cfcddc admin admin] Calling method '>' {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:28:56.724158 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.requestlog [None req-6812f1d9-05af-48e4-886d-3949d6cfcddc admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001679 Jun 23 22:28:56.724745 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: [pid: 103357|app: 0|req: 6/10] 10.222.0.43 () {54 vars in 930 bytes} [Thu Jun 23 22:28:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:28:56.786695 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-7b9390c2-5cfe-4e03-b374-fe48ee8f1a73 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "os-flavor-access:is_public": true, "vcpus": 1, "id": "d2", "swap": 0, "rxtx_factor": 1.0, "ram": 1024, "name": "ds1G"}} {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:28:56.806394 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-7b9390c2-5cfe-4e03-b374-fe48ee8f1a73 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076107 Jun 23 22:28:56.807155 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 5/11] 10.222.0.43 () {64 vars in 1282 bytes} [Thu Jun 23 22:28:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 22:28:56.819452 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-ff223585-f937-4e55-aa35-063031476d4d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:28:56.844591 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.requestlog [None req-ff223585-f937-4e55-aa35-063031476d4d admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029371 Jun 23 22:28:56.845403 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: [pid: 103357|app: 0|req: 7/12] 10.222.0.43 () {64 vars in 1335 bytes} [Thu Jun 23 22:28:56 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:28:58.994116 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-7b9390c2-5cfe-4e03-b374-fe48ee8f1a73 admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:28:58.995167 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-7b9390c2-5cfe-4e03-b374-fe48ee8f1a73 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jun 23 22:28:58.995574 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 6/13] 10.222.0.43 () {54 vars in 930 bytes} [Thu Jun 23 22:28:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:28:59.059938 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-7aac0418-d22f-4936-b86e-f20857576caa admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "id": "d3", "disk": 10, "os-flavor-access:is_public": true, "ram": 2048, "name": "ds2G"}} {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:28:59.078098 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.requestlog [None req-7aac0418-d22f-4936-b86e-f20857576caa admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076425 Jun 23 22:28:59.078650 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: [pid: 103357|app: 0|req: 8/14] 10.222.0.43 () {64 vars in 1282 bytes} [Thu Jun 23 22:28:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 22:28:59.091486 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-f57e5918-3b40-4960-b193-27b515dc4cce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:28:59.116266 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-f57e5918-3b40-4960-b193-27b515dc4cce admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028522 Jun 23 22:28:59.116847 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 7/15] 10.222.0.43 () {64 vars in 1335 bytes} [Thu Jun 23 22:28:59 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:29:01.375977 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-7aac0418-d22f-4936-b86e-f20857576caa admin admin] Calling method '>' {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:29:01.377079 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.requestlog [None req-7aac0418-d22f-4936-b86e-f20857576caa admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Jun 23 22:29:01.377550 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: [pid: 103357|app: 0|req: 9/16] 10.222.0.43 () {54 vars in 930 bytes} [Thu Jun 23 22:29:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:29:01.436693 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-a3fa6849-b464-4633-86bc-1f775fdc22c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "vcpus": 4, "id": "d4", "name": "ds4G"}} {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:29:01.455053 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-a3fa6849-b464-4633-86bc-1f775fdc22c1 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071022 Jun 23 22:29:01.455651 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 8/17] 10.222.0.43 () {64 vars in 1282 bytes} [Thu Jun 23 22:29:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 22:29:01.467484 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-3cba1f04-1296-4f24-88c1-86fadfbcee87 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:29:01.490337 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.requestlog [None req-3cba1f04-1296-4f24-88c1-86fadfbcee87 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026604 Jun 23 22:29:01.491000 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: [pid: 103357|app: 0|req: 10/18] 10.222.0.43 () {64 vars in 1335 bytes} [Thu Jun 23 22:29:01 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:29:03.678865 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-a3fa6849-b464-4633-86bc-1f775fdc22c1 admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:29:03.679899 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-a3fa6849-b464-4633-86bc-1f775fdc22c1 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001755 Jun 23 22:29:03.680294 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 9/19] 10.222.0.43 () {54 vars in 930 bytes} [Thu Jun 23 22:29:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:29:03.745352 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-305f21db-a4cd-4e3d-b67e-5ff7945b4c14 admin admin] Calling method '>' {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:29:03.771104 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.requestlog [None req-305f21db-a4cd-4e3d-b67e-5ff7945b4c14 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.084608 Jun 23 22:29:03.771874 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: [pid: 103357|app: 0|req: 11/20] 10.222.0.43 () {60 vars in 1291 bytes} [Thu Jun 23 22:29:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:29:06.006131 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-a3fa6849-b464-4633-86bc-1f775fdc22c1 admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:29:06.008229 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-a3fa6849-b464-4633-86bc-1f775fdc22c1 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jun 23 22:29:06.008907 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 10/21] 10.222.0.43 () {54 vars in 930 bytes} [Thu Jun 23 22:29:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:29:06.074366 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-404375aa-76e8-43f6-aad2-c33c5995ce84 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "ram": 512, "id": "1", "name": "m1.tiny", "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:29:06.094302 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.requestlog [None req-404375aa-76e8-43f6-aad2-c33c5995ce84 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.078752 Jun 23 22:29:06.094851 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: [pid: 103357|app: 0|req: 12/22] 10.222.0.43 () {64 vars in 1282 bytes} [Thu Jun 23 22:29:06 2022] POST /compute/v2.1/flavors => generated 402 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 22:29:06.108118 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-e1bd076f-3bf4-4c17-9d3d-8eb584992bdb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:29:06.137639 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-e1bd076f-3bf4-4c17-9d3d-8eb584992bdb admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033266 Jun 23 22:29:06.138327 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 11/23] 10.222.0.43 () {64 vars in 1332 bytes} [Thu Jun 23 22:29:06 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:29:08.425734 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-404375aa-76e8-43f6-aad2-c33c5995ce84 admin admin] Calling method '>' {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:29:08.427068 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.requestlog [None req-404375aa-76e8-43f6-aad2-c33c5995ce84 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001925 Jun 23 22:29:08.427609 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: [pid: 103357|app: 0|req: 13/24] 10.222.0.43 () {54 vars in 930 bytes} [Thu Jun 23 22:29:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:29:08.491058 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-def5eddb-f76e-4e09-91de-58715522b81e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 20, "vcpus": 1, "name": "m1.small", "id": "2", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0}} {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:29:08.510014 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-def5eddb-f76e-4e09-91de-58715522b81e admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076506 Jun 23 22:29:08.510708 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 12/25] 10.222.0.43 () {64 vars in 1282 bytes} [Thu Jun 23 22:29:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 22:29:08.523042 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-2ae0a031-8efa-418b-a050-c325f0644975 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:29:08.547436 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.requestlog [None req-2ae0a031-8efa-418b-a050-c325f0644975 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027879 Jun 23 22:29:08.548168 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: [pid: 103357|app: 0|req: 14/26] 10.222.0.43 () {64 vars in 1332 bytes} [Thu Jun 23 22:29:08 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:29:11.076179 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-def5eddb-f76e-4e09-91de-58715522b81e admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:29:11.077742 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-def5eddb-f76e-4e09-91de-58715522b81e admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001996 Jun 23 22:29:11.078141 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 13/27] 10.222.0.43 () {54 vars in 930 bytes} [Thu Jun 23 22:29:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:29:11.153576 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-2b3825ab-9ce0-4a2c-9e07-74a01a126719 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 40, "os-flavor-access:is_public": true, "ram": 4096, "id": "3", "name": "m1.medium"}} {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:29:11.171577 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.requestlog [None req-2b3825ab-9ce0-4a2c-9e07-74a01a126719 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.086900 Jun 23 22:29:11.172129 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: [pid: 103357|app: 0|req: 15/28] 10.222.0.43 () {64 vars in 1282 bytes} [Thu Jun 23 22:29:11 2022] POST /compute/v2.1/flavors => generated 406 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 22:29:11.184849 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-3e1a6464-4d85-4ee9-9910-6a5f105ef25f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:29:11.208624 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-3e1a6464-4d85-4ee9-9910-6a5f105ef25f admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027390 Jun 23 22:29:11.209427 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 14/29] 10.222.0.43 () {64 vars in 1332 bytes} [Thu Jun 23 22:29:11 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:29:13.329931 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-2b3825ab-9ce0-4a2c-9e07-74a01a126719 admin admin] Calling method '>' {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:29:13.331503 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.requestlog [None req-2b3825ab-9ce0-4a2c-9e07-74a01a126719 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002129 Jun 23 22:29:13.332019 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: [pid: 103357|app: 0|req: 16/30] 10.222.0.43 () {54 vars in 930 bytes} [Thu Jun 23 22:29:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:29:13.390304 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-8b8e1c40-abf5-4fa2-b3a9-0b042c9be67f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "id": "4", "ram": 8192, "name": "m1.large", "vcpus": 4}} {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:29:13.409818 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-8b8e1c40-abf5-4fa2-b3a9-0b042c9be67f admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.070338 Jun 23 22:29:13.409818 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 15/31] 10.222.0.43 () {64 vars in 1282 bytes} [Thu Jun 23 22:29:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 22:29:13.421300 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-178532a0-d0f2-4c2c-8565-095c8e316aeb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:29:13.445110 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.requestlog [None req-178532a0-d0f2-4c2c-8565-095c8e316aeb admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027370 Jun 23 22:29:13.445670 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: [pid: 103357|app: 0|req: 17/32] 10.222.0.43 () {64 vars in 1332 bytes} [Thu Jun 23 22:29:13 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:29:15.571336 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-8b8e1c40-abf5-4fa2-b3a9-0b042c9be67f admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:29:15.572956 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-8b8e1c40-abf5-4fa2-b3a9-0b042c9be67f admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002076 Jun 23 22:29:15.573360 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 16/33] 10.222.0.43 () {54 vars in 930 bytes} [Thu Jun 23 22:29:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:29:15.640394 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-f1e8d034-4ab2-4279-8f6c-38828913828d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "swap": 0, "rxtx_factor": 1.0, "id": "5", "disk": 160, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "os-flavor-access:is_public": true}} {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:29:15.662079 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.requestlog [None req-f1e8d034-4ab2-4279-8f6c-38828913828d admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.081812 Jun 23 22:29:15.663460 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: [pid: 103357|app: 0|req: 18/34] 10.222.0.43 () {64 vars in 1282 bytes} [Thu Jun 23 22:29:15 2022] POST /compute/v2.1/flavors => generated 408 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 22:29:15.680504 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-77d50edf-448c-4292-9151-50b78a738802 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:29:15.704852 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-77d50edf-448c-4292-9151-50b78a738802 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029435 Jun 23 22:29:15.705864 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 17/35] 10.222.0.43 () {64 vars in 1332 bytes} [Thu Jun 23 22:29:15 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:29:39.947308 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-f1e8d034-4ab2-4279-8f6c-38828913828d admin admin] Calling method '>' {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:29:39.948316 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.requestlog [None req-f1e8d034-4ab2-4279-8f6c-38828913828d admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jun 23 22:29:39.948718 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: [pid: 103357|app: 0|req: 19/36] 10.222.0.43 () {54 vars in 930 bytes} [Thu Jun 23 22:29:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:29:39.959683 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG dbcounter [-] [103356] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:29:40.007500 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-13c4514d-1357-4e27-8b2b-f0d5116ed821 admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:29:40.024701 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-13c4514d-1357-4e27-8b2b-f0d5116ed821 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070376 Jun 23 22:29:40.025231 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 18/37] 10.222.0.43 () {60 vars in 1291 bytes} [Thu Jun 23 22:29:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:29:40.941985 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-f1e8d034-4ab2-4279-8f6c-38828913828d admin admin] Calling method '>' {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:29:40.943121 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.requestlog [None req-f1e8d034-4ab2-4279-8f6c-38828913828d admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001623 Jun 23 22:29:40.943522 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: [pid: 103357|app: 0|req: 20/38] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Jun 23 22:29:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:29:41.134705 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-a7a96f2a-dddd-4bfe-a72c-44b1df6e8bd7 admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:29:41.140415 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.wsgi [None req-a7a96f2a-dddd-4bfe-a72c-44b1df6e8bd7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 23 22:29:41.143710 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-a7a96f2a-dddd-4bfe-a72c-44b1df6e8bd7 admin admin] Request method failure captured: Jun 23 22:29:41.143710 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 23 22:29:41.143710 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: Accept: application/json Jun 23 22:29:41.143710 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: Accept-Encoding: gzip, deflate Jun 23 22:29:41.143710 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: Connection: keep-alive Jun 23 22:29:41.143710 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: Content-Length: 0 Jun 23 22:29:41.143710 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: Host: 10.222.0.43 Jun 23 22:29:41.143710 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: Openstack-Api-Version: compute 2.90 Jun 23 22:29:41.143710 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: Openstack-System-Scope: None Jun 23 22:29:41.143710 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: User-Agent: python-novaclient Jun 23 22:29:41.143710 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Auth-Token: gAAAAABitOlUZ8bgsTO_1lcbpEyOR1d8XDiNgEKuuxu89JOOoTawl7eQh9YcPmNAdhCkeagtFC1yZIGz_ftRGIU8NXHZ9_9i3wssZkHwOuBeOM5hLZvZ8pM73Z7zHXJNt0fYgX17FV_oGmFnkjZvxMpFLKtahHOsUR7LQNlqsRQLbP35b0Tb-yI Jun 23 22:29:41.143710 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Domain-Id: None Jun 23 22:29:41.143710 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Domain-Name: None Jun 23 22:29:41.143710 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Identity-Status: Confirmed Jun 23 22:29:41.143710 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Is-Admin-Project: True Jun 23 22:29:41.143710 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 22:29:41.143710 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Project-Domain-Id: default Jun 23 22:29:41.143710 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Project-Domain-Name: Default Jun 23 22:29:41.143710 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Project-Id: 1aef1dab34da4006bf2529ee1b5120da Jun 23 22:29:41.143710 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Project-Name: admin Jun 23 22:29:41.143710 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Role: admin,reader,member Jun 23 22:29:41.143710 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Roles: admin,reader,member Jun 23 22:29:41.145748 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1aef1dab34da4006bf2529ee1b5120da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1aef1dab34da4006bf2529ee1b5120da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1aef1dab34da4006bf2529ee1b5120da", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1aef1dab34da4006bf2529ee1b5120da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:29:41.145748 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Tenant: admin Jun 23 22:29:41.145748 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Tenant-Id: 1aef1dab34da4006bf2529ee1b5120da Jun 23 22:29:41.145748 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Tenant-Name: admin Jun 23 22:29:41.145748 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-User: admin Jun 23 22:29:41.145748 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-User-Domain-Id: default Jun 23 22:29:41.145748 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-User-Domain-Name: Default Jun 23 22:29:41.145748 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-User-Id: c3c5fce3a5074734811c3407aac7fd6b Jun 23 22:29:41.145748 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-User-Name: admin Jun 23 22:29:41.145748 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: method: > Jun 23 22:29:41.145748 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: exception: Flavor 42 could not be found. Jun 23 22:29:41.145748 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: action_args: {'id': '42'} Jun 23 22:29:41.145748 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:29:41.145748 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:29:41.146784 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 22:29:41.146784 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 22:29:41.146784 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 22:29:41.146784 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 22:29:41.146784 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 22:29:41.146784 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 22:29:41.146784 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 22:29:41.146784 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 22:29:41.146784 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 22:29:41.146784 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:29:41.146784 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 22:29:41.146784 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 22:29:41.146784 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 23 22:29:41.146784 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Jun 23 22:29:41.146784 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:29:41.146784 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Jun 23 22:29:41.146784 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:29:41.146784 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:29:41.146784 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:29:41.148174 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:29:41.148174 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:29:41.148174 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:29:41.148174 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:29:41.148174 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 22:29:41.148174 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:29:41.148174 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 23 22:29:41.148174 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Jun 23 22:29:41.148174 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:29:41.148174 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Jun 23 22:29:41.148174 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:29:41.148174 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:29:41.148174 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:29:41.148174 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:29:41.148174 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:29:41.148174 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 23 22:29:41.148174 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Jun 23 22:29:41.148174 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-a7a96f2a-dddd-4bfe-a72c-44b1df6e8bd7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:29:41.149473 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-a7a96f2a-dddd-4bfe-a72c-44b1df6e8bd7 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.063081 Jun 23 22:29:41.149473 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 19/39] 10.222.0.43 () {60 vars in 1190 bytes} [Thu Jun 23 22:29:41 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 22:29:41.154952 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-640bd99c-7db8-4e1c-a78d-a576a49e6367 admin admin] Calling method '>' {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:29:41.157937 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG dbcounter [-] [103357] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:29:41.178052 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.requestlog [None req-640bd99c-7db8-4e1c-a78d-a576a49e6367 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026937 Jun 23 22:29:41.178586 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: [pid: 103357|app: 0|req: 21/40] 10.222.0.43 () {60 vars in 1210 bytes} [Thu Jun 23 22:29:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:29:41.188108 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-9832aaec-aa06-4b53-8260-3017891e7943 admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:29:41.210729 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-9832aaec-aa06-4b53-8260-3017891e7943 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026123 Jun 23 22:29:41.211296 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 20/41] 10.222.0.43 () {60 vars in 1210 bytes} [Thu Jun 23 22:29:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:29:41.220495 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-e259e313-e17d-40a9-9b25-4688e30dc410 admin admin] Calling method '>' {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:29:41.226910 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.wsgi [None req-e259e313-e17d-40a9-9b25-4688e30dc410 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 23 22:29:41.230121 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-e259e313-e17d-40a9-9b25-4688e30dc410 admin admin] Request method failure captured: Jun 23 22:29:41.230121 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 23 22:29:41.230121 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: Accept: application/json Jun 23 22:29:41.230121 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: Accept-Encoding: gzip, deflate Jun 23 22:29:41.230121 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: Connection: keep-alive Jun 23 22:29:41.230121 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: Content-Length: 0 Jun 23 22:29:41.230121 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: Host: 10.222.0.43 Jun 23 22:29:41.230121 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: Openstack-Api-Version: compute 2.90 Jun 23 22:29:41.230121 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: Openstack-System-Scope: None Jun 23 22:29:41.230121 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: User-Agent: python-novaclient Jun 23 22:29:41.230121 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Auth-Token: gAAAAABitOlUZ8bgsTO_1lcbpEyOR1d8XDiNgEKuuxu89JOOoTawl7eQh9YcPmNAdhCkeagtFC1yZIGz_ftRGIU8NXHZ9_9i3wssZkHwOuBeOM5hLZvZ8pM73Z7zHXJNt0fYgX17FV_oGmFnkjZvxMpFLKtahHOsUR7LQNlqsRQLbP35b0Tb-yI Jun 23 22:29:41.230121 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Domain-Id: None Jun 23 22:29:41.230121 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Domain-Name: None Jun 23 22:29:41.230121 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Identity-Status: Confirmed Jun 23 22:29:41.230121 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Is-Admin-Project: True Jun 23 22:29:41.230121 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 22:29:41.230121 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Project-Domain-Id: default Jun 23 22:29:41.230121 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Project-Domain-Name: Default Jun 23 22:29:41.230121 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Project-Id: 1aef1dab34da4006bf2529ee1b5120da Jun 23 22:29:41.230121 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Project-Name: admin Jun 23 22:29:41.230121 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Role: admin,reader,member Jun 23 22:29:41.230121 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Roles: admin,reader,member Jun 23 22:29:41.231680 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1aef1dab34da4006bf2529ee1b5120da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1aef1dab34da4006bf2529ee1b5120da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1aef1dab34da4006bf2529ee1b5120da", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1aef1dab34da4006bf2529ee1b5120da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:29:41.231680 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Tenant: admin Jun 23 22:29:41.231680 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Tenant-Id: 1aef1dab34da4006bf2529ee1b5120da Jun 23 22:29:41.231680 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Tenant-Name: admin Jun 23 22:29:41.231680 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-User: admin Jun 23 22:29:41.231680 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-User-Domain-Id: default Jun 23 22:29:41.231680 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-User-Domain-Name: Default Jun 23 22:29:41.231680 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-User-Id: c3c5fce3a5074734811c3407aac7fd6b Jun 23 22:29:41.231680 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-User-Name: admin Jun 23 22:29:41.231680 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: method: > Jun 23 22:29:41.231680 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: exception: Flavor 42 could not be found. Jun 23 22:29:41.231680 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: action_args: {'id': '42'} Jun 23 22:29:41.231680 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:29:41.231680 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:29:41.232884 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 22:29:41.232884 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 22:29:41.232884 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 22:29:41.232884 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 22:29:41.232884 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 22:29:41.232884 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 22:29:41.232884 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 22:29:41.232884 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 22:29:41.232884 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 22:29:41.232884 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:29:41.232884 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 22:29:41.232884 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 22:29:41.232884 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 23 22:29:41.232884 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi Jun 23 22:29:41.232884 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:29:41.232884 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi Jun 23 22:29:41.232884 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:29:41.232884 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:29:41.232884 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:29:41.234002 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:29:41.234002 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:29:41.234002 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:29:41.234002 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:29:41.234002 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 22:29:41.234002 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:29:41.234002 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 23 22:29:41.234002 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi Jun 23 22:29:41.234002 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:29:41.234002 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi Jun 23 22:29:41.234002 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:29:41.234002 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:29:41.234002 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:29:41.234002 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:29:41.234002 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:29:41.234002 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 23 22:29:41.234002 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi Jun 23 22:29:41.234002 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-e259e313-e17d-40a9-9b25-4688e30dc410 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:29:41.235040 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.requestlog [None req-e259e313-e17d-40a9-9b25-4688e30dc410 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014536 Jun 23 22:29:41.235040 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: [pid: 103357|app: 0|req: 22/42] 10.222.0.43 () {60 vars in 1190 bytes} [Thu Jun 23 22:29:41 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 23 22:29:42.051312 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-9832aaec-aa06-4b53-8260-3017891e7943 admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:29:42.052326 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-9832aaec-aa06-4b53-8260-3017891e7943 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 23 22:29:42.052713 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 21/43] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Jun 23 22:29:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:29:42.245106 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-affb71df-10eb-41be-a7f8-18048584be10 admin admin] Calling method '>' {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:29:42.252438 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.wsgi [None req-affb71df-10eb-41be-a7f8-18048584be10 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 23 22:29:42.254203 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-affb71df-10eb-41be-a7f8-18048584be10 admin admin] Request method failure captured: Jun 23 22:29:42.254203 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 23 22:29:42.254203 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: Accept: application/json Jun 23 22:29:42.254203 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: Accept-Encoding: gzip, deflate Jun 23 22:29:42.254203 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: Connection: keep-alive Jun 23 22:29:42.254203 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: Content-Length: 0 Jun 23 22:29:42.254203 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: Host: 10.222.0.43 Jun 23 22:29:42.254203 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: Openstack-Api-Version: compute 2.90 Jun 23 22:29:42.254203 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: Openstack-System-Scope: None Jun 23 22:29:42.254203 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: User-Agent: python-novaclient Jun 23 22:29:42.254203 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Auth-Token: gAAAAABitOlWTOccpkfuD0V9qSCmT6rflOquwrGvBaNhDS9hFiTeOvzSUZLrOyadOrXZIXJ7pgqRq8Qwl34Fd4SbU6r0hnktuqxN6biXK0xmUBhUhU0iA8AWn1Zr4YVtnKdooEmOaoVsX8mULFa9iNJPP-gsc1MIvFtqQrwzP-EVAoxnlMRHuss Jun 23 22:29:42.254203 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Domain-Id: None Jun 23 22:29:42.254203 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Domain-Name: None Jun 23 22:29:42.254203 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Identity-Status: Confirmed Jun 23 22:29:42.254203 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Is-Admin-Project: True Jun 23 22:29:42.254203 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 22:29:42.254203 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Project-Domain-Id: default Jun 23 22:29:42.254203 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Project-Domain-Name: Default Jun 23 22:29:42.254203 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Project-Id: 1aef1dab34da4006bf2529ee1b5120da Jun 23 22:29:42.254203 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Project-Name: admin Jun 23 22:29:42.254203 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Role: admin,reader,member Jun 23 22:29:42.254203 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Roles: admin,reader,member Jun 23 22:29:42.255784 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1aef1dab34da4006bf2529ee1b5120da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1aef1dab34da4006bf2529ee1b5120da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1aef1dab34da4006bf2529ee1b5120da", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1aef1dab34da4006bf2529ee1b5120da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:29:42.255784 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Tenant: admin Jun 23 22:29:42.255784 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Tenant-Id: 1aef1dab34da4006bf2529ee1b5120da Jun 23 22:29:42.255784 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Tenant-Name: admin Jun 23 22:29:42.255784 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-User: admin Jun 23 22:29:42.255784 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-User-Domain-Id: default Jun 23 22:29:42.255784 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-User-Domain-Name: Default Jun 23 22:29:42.255784 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-User-Id: c3c5fce3a5074734811c3407aac7fd6b Jun 23 22:29:42.255784 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-User-Name: admin Jun 23 22:29:42.255784 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: method: > Jun 23 22:29:42.255784 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: exception: Flavor 84 could not be found. Jun 23 22:29:42.255784 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: action_args: {'id': '84'} Jun 23 22:29:42.255784 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:29:42.255784 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:29:42.256810 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 22:29:42.256810 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 22:29:42.256810 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 22:29:42.256810 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 22:29:42.256810 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 22:29:42.256810 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 22:29:42.256810 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 22:29:42.256810 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 22:29:42.256810 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 22:29:42.256810 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:29:42.256810 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 22:29:42.256810 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 22:29:42.256810 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 23 22:29:42.256810 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi Jun 23 22:29:42.256810 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:29:42.256810 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi Jun 23 22:29:42.256810 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:29:42.256810 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:29:42.256810 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:29:42.258181 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:29:42.258181 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:29:42.258181 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:29:42.258181 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:29:42.258181 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 22:29:42.258181 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:29:42.258181 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 23 22:29:42.258181 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi Jun 23 22:29:42.258181 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:29:42.258181 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi Jun 23 22:29:42.258181 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:29:42.258181 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:29:42.258181 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:29:42.258181 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:29:42.258181 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:29:42.258181 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 23 22:29:42.258181 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi Jun 23 22:29:42.258181 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-affb71df-10eb-41be-a7f8-18048584be10 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:29:42.259528 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.requestlog [None req-affb71df-10eb-41be-a7f8-18048584be10 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.062213 Jun 23 22:29:42.259528 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: [pid: 103357|app: 0|req: 23/44] 10.222.0.43 () {60 vars in 1190 bytes} [Thu Jun 23 22:29:42 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 23 22:29:42.265333 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-8554212e-880d-4e65-a4cd-bc011b2f11aa admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:29:42.278674 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-8554212e-880d-4e65-a4cd-bc011b2f11aa admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017041 Jun 23 22:29:42.279481 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 22/45] 10.222.0.43 () {60 vars in 1210 bytes} [Thu Jun 23 22:29:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:29:42.289078 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-5e54cdcd-c837-4baa-b402-944807435114 admin admin] Calling method '>' {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:29:42.303474 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.requestlog [None req-5e54cdcd-c837-4baa-b402-944807435114 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017804 Jun 23 22:29:42.304014 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: [pid: 103357|app: 0|req: 24/46] 10.222.0.43 () {60 vars in 1210 bytes} [Thu Jun 23 22:29:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:29:42.314068 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-8f612e52-442c-4278-8216-f156c70d904d admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:29:42.319456 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.wsgi [None req-8f612e52-442c-4278-8216-f156c70d904d admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 23 22:29:42.321079 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-8f612e52-442c-4278-8216-f156c70d904d admin admin] Request method failure captured: Jun 23 22:29:42.321079 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 23 22:29:42.321079 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: Accept: application/json Jun 23 22:29:42.321079 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: Accept-Encoding: gzip, deflate Jun 23 22:29:42.321079 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: Connection: keep-alive Jun 23 22:29:42.321079 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: Content-Length: 0 Jun 23 22:29:42.321079 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: Host: 10.222.0.43 Jun 23 22:29:42.321079 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: Openstack-Api-Version: compute 2.90 Jun 23 22:29:42.321079 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: Openstack-System-Scope: None Jun 23 22:29:42.321079 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: User-Agent: python-novaclient Jun 23 22:29:42.321079 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Auth-Token: gAAAAABitOlWTOccpkfuD0V9qSCmT6rflOquwrGvBaNhDS9hFiTeOvzSUZLrOyadOrXZIXJ7pgqRq8Qwl34Fd4SbU6r0hnktuqxN6biXK0xmUBhUhU0iA8AWn1Zr4YVtnKdooEmOaoVsX8mULFa9iNJPP-gsc1MIvFtqQrwzP-EVAoxnlMRHuss Jun 23 22:29:42.321079 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Domain-Id: None Jun 23 22:29:42.321079 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Domain-Name: None Jun 23 22:29:42.321079 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Identity-Status: Confirmed Jun 23 22:29:42.321079 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Is-Admin-Project: True Jun 23 22:29:42.321079 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 22:29:42.321079 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Project-Domain-Id: default Jun 23 22:29:42.321079 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Project-Domain-Name: Default Jun 23 22:29:42.321079 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Project-Id: 1aef1dab34da4006bf2529ee1b5120da Jun 23 22:29:42.321079 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Project-Name: admin Jun 23 22:29:42.321079 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Role: admin,reader,member Jun 23 22:29:42.321079 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Roles: admin,reader,member Jun 23 22:29:42.322612 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1aef1dab34da4006bf2529ee1b5120da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1aef1dab34da4006bf2529ee1b5120da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1aef1dab34da4006bf2529ee1b5120da", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1aef1dab34da4006bf2529ee1b5120da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:29:42.322612 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Tenant: admin Jun 23 22:29:42.322612 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Tenant-Id: 1aef1dab34da4006bf2529ee1b5120da Jun 23 22:29:42.322612 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Tenant-Name: admin Jun 23 22:29:42.322612 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-User: admin Jun 23 22:29:42.322612 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-User-Domain-Id: default Jun 23 22:29:42.322612 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-User-Domain-Name: Default Jun 23 22:29:42.322612 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-User-Id: c3c5fce3a5074734811c3407aac7fd6b Jun 23 22:29:42.322612 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-User-Name: admin Jun 23 22:29:42.322612 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: method: > Jun 23 22:29:42.322612 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: exception: Flavor 84 could not be found. Jun 23 22:29:42.322612 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: action_args: {'id': '84'} Jun 23 22:29:42.322612 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:29:42.322612 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:29:42.323498 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 22:29:42.323498 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 22:29:42.323498 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 22:29:42.323498 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 22:29:42.323498 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 22:29:42.323498 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 22:29:42.323498 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 22:29:42.323498 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 22:29:42.323498 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 22:29:42.323498 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:29:42.323498 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 22:29:42.323498 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 22:29:42.323498 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 23 22:29:42.323498 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Jun 23 22:29:42.323498 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:29:42.323498 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Jun 23 22:29:42.323498 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:29:42.323498 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:29:42.323498 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:29:42.324607 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:29:42.324607 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:29:42.324607 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:29:42.324607 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:29:42.324607 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 22:29:42.324607 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:29:42.324607 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 23 22:29:42.324607 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Jun 23 22:29:42.324607 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:29:42.324607 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Jun 23 22:29:42.324607 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:29:42.324607 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:29:42.324607 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:29:42.324607 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:29:42.324607 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:29:42.324607 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 23 22:29:42.324607 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Jun 23 22:29:42.324607 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-8f612e52-442c-4278-8216-f156c70d904d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:29:42.325638 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-8f612e52-442c-4278-8216-f156c70d904d admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011855 Jun 23 22:29:42.325638 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 23/47] 10.222.0.43 () {60 vars in 1190 bytes} [Thu Jun 23 22:29:42 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 22:29:43.150672 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-5e54cdcd-c837-4baa-b402-944807435114 admin admin] Calling method '>' {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:29:43.151702 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.requestlog [None req-5e54cdcd-c837-4baa-b402-944807435114 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jun 23 22:29:43.152099 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: [pid: 103357|app: 0|req: 25/48] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Jun 23 22:29:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:29:43.344570 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-f41be8b6-2928-4c66-b1b6-e8b81f435282 admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:29:43.350847 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.wsgi [None req-f41be8b6-2928-4c66-b1b6-e8b81f435282 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 23 22:29:43.352990 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-f41be8b6-2928-4c66-b1b6-e8b81f435282 admin admin] Request method failure captured: Jun 23 22:29:43.352990 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 23 22:29:43.352990 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: Accept: application/json Jun 23 22:29:43.352990 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: Accept-Encoding: gzip, deflate Jun 23 22:29:43.352990 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: Connection: keep-alive Jun 23 22:29:43.352990 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: Content-Length: 0 Jun 23 22:29:43.352990 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: Host: 10.222.0.43 Jun 23 22:29:43.352990 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: Openstack-Api-Version: compute 2.90 Jun 23 22:29:43.352990 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: Openstack-System-Scope: None Jun 23 22:29:43.352990 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: User-Agent: python-novaclient Jun 23 22:29:43.352990 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Auth-Token: gAAAAABitOlXM1P21ujJ11lms0Xu-BUZqEocELf_5VvzkSoKyhltzYiYw1q_NCbUHV-r923HBsqghh6pu_sIdsTkE4CmFQEOkPmEPADGOCJgLcUtgBAHMegaTAltyrm-J6DyNsUmjD7OAaBztqAbXtNoaOlrkLksyoMA7cuT8IpvaLPPBVd3UEQ Jun 23 22:29:43.352990 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Domain-Id: None Jun 23 22:29:43.352990 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Domain-Name: None Jun 23 22:29:43.352990 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Identity-Status: Confirmed Jun 23 22:29:43.352990 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Is-Admin-Project: True Jun 23 22:29:43.352990 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 22:29:43.352990 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Project-Domain-Id: default Jun 23 22:29:43.352990 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Project-Domain-Name: Default Jun 23 22:29:43.352990 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Project-Id: 1aef1dab34da4006bf2529ee1b5120da Jun 23 22:29:43.352990 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Project-Name: admin Jun 23 22:29:43.352990 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Role: admin,reader,member Jun 23 22:29:43.352990 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Roles: admin,reader,member Jun 23 22:29:43.355174 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1aef1dab34da4006bf2529ee1b5120da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1aef1dab34da4006bf2529ee1b5120da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1aef1dab34da4006bf2529ee1b5120da", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1aef1dab34da4006bf2529ee1b5120da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:29:43.355174 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Tenant: admin Jun 23 22:29:43.355174 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Tenant-Id: 1aef1dab34da4006bf2529ee1b5120da Jun 23 22:29:43.355174 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-Tenant-Name: admin Jun 23 22:29:43.355174 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-User: admin Jun 23 22:29:43.355174 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-User-Domain-Id: default Jun 23 22:29:43.355174 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-User-Domain-Name: Default Jun 23 22:29:43.355174 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-User-Id: c3c5fce3a5074734811c3407aac7fd6b Jun 23 22:29:43.355174 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: X-User-Name: admin Jun 23 22:29:43.355174 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: method: > Jun 23 22:29:43.355174 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: exception: Flavor 451 could not be found. Jun 23 22:29:43.355174 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: action_args: {'id': '451'} Jun 23 22:29:43.355174 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:29:43.355174 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:29:43.356075 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 22:29:43.356075 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 22:29:43.356075 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 22:29:43.356075 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 22:29:43.356075 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 22:29:43.356075 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 22:29:43.356075 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 22:29:43.356075 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 22:29:43.356075 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 22:29:43.356075 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:29:43.356075 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 22:29:43.356075 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 22:29:43.356075 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 23 22:29:43.356075 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Jun 23 22:29:43.356075 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:29:43.356075 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Jun 23 22:29:43.356075 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:29:43.356075 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:29:43.356075 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:29:43.357140 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:29:43.357140 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:29:43.357140 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:29:43.357140 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:29:43.357140 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 22:29:43.357140 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:29:43.357140 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 23 22:29:43.357140 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Jun 23 22:29:43.357140 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:29:43.357140 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Jun 23 22:29:43.357140 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:29:43.357140 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:29:43.357140 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:29:43.357140 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:29:43.357140 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:29:43.357140 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 23 22:29:43.357140 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: ERROR nova.api.openstack.wsgi Jun 23 22:29:43.357140 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-f41be8b6-2928-4c66-b1b6-e8b81f435282 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103356) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:29:43.358155 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-f41be8b6-2928-4c66-b1b6-e8b81f435282 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060792 Jun 23 22:29:43.358155 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 24/49] 10.222.0.43 () {60 vars in 1193 bytes} [Thu Jun 23 22:29:43 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 22:29:43.364282 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-8fa09128-4ca0-4293-aa44-45a972ba05b7 admin admin] Calling method '>' {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:29:43.377933 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.requestlog [None req-8fa09128-4ca0-4293-aa44-45a972ba05b7 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017622 Jun 23 22:29:43.378653 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: [pid: 103357|app: 0|req: 26/50] 10.222.0.43 () {60 vars in 1210 bytes} [Thu Jun 23 22:29:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:29:43.388101 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-73822d71-4fea-45aa-8291-6da75f623d77 admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:29:43.402148 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-73822d71-4fea-45aa-8291-6da75f623d77 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017552 Jun 23 22:29:43.402668 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 25/51] 10.222.0.43 () {60 vars in 1210 bytes} [Thu Jun 23 22:29:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:29:43.412675 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-577bad6f-4f18-4b75-ae1a-90cecb927db6 admin admin] Calling method '>' {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:29:43.418295 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.wsgi [None req-577bad6f-4f18-4b75-ae1a-90cecb927db6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 23 22:29:43.419802 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-577bad6f-4f18-4b75-ae1a-90cecb927db6 admin admin] Request method failure captured: Jun 23 22:29:43.419802 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 23 22:29:43.419802 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: Accept: application/json Jun 23 22:29:43.419802 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: Accept-Encoding: gzip, deflate Jun 23 22:29:43.419802 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: Connection: keep-alive Jun 23 22:29:43.419802 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: Content-Length: 0 Jun 23 22:29:43.419802 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: Host: 10.222.0.43 Jun 23 22:29:43.419802 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: Openstack-Api-Version: compute 2.90 Jun 23 22:29:43.419802 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: Openstack-System-Scope: None Jun 23 22:29:43.419802 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: User-Agent: python-novaclient Jun 23 22:29:43.419802 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Auth-Token: gAAAAABitOlXM1P21ujJ11lms0Xu-BUZqEocELf_5VvzkSoKyhltzYiYw1q_NCbUHV-r923HBsqghh6pu_sIdsTkE4CmFQEOkPmEPADGOCJgLcUtgBAHMegaTAltyrm-J6DyNsUmjD7OAaBztqAbXtNoaOlrkLksyoMA7cuT8IpvaLPPBVd3UEQ Jun 23 22:29:43.419802 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Domain-Id: None Jun 23 22:29:43.419802 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Domain-Name: None Jun 23 22:29:43.419802 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Identity-Status: Confirmed Jun 23 22:29:43.419802 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Is-Admin-Project: True Jun 23 22:29:43.419802 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 22:29:43.419802 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Project-Domain-Id: default Jun 23 22:29:43.419802 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Project-Domain-Name: Default Jun 23 22:29:43.419802 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Project-Id: 1aef1dab34da4006bf2529ee1b5120da Jun 23 22:29:43.419802 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Project-Name: admin Jun 23 22:29:43.419802 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Role: admin,reader,member Jun 23 22:29:43.419802 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Roles: admin,reader,member Jun 23 22:29:43.421161 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1aef1dab34da4006bf2529ee1b5120da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1aef1dab34da4006bf2529ee1b5120da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1aef1dab34da4006bf2529ee1b5120da", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1aef1dab34da4006bf2529ee1b5120da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:29:43.421161 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Tenant: admin Jun 23 22:29:43.421161 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Tenant-Id: 1aef1dab34da4006bf2529ee1b5120da Jun 23 22:29:43.421161 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-Tenant-Name: admin Jun 23 22:29:43.421161 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-User: admin Jun 23 22:29:43.421161 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-User-Domain-Id: default Jun 23 22:29:43.421161 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-User-Domain-Name: Default Jun 23 22:29:43.421161 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-User-Id: c3c5fce3a5074734811c3407aac7fd6b Jun 23 22:29:43.421161 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: X-User-Name: admin Jun 23 22:29:43.421161 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: method: > Jun 23 22:29:43.421161 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: exception: Flavor 451 could not be found. Jun 23 22:29:43.421161 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: action_args: {'id': '451'} Jun 23 22:29:43.421161 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:29:43.421161 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:29:43.422039 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 22:29:43.422039 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 22:29:43.422039 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 22:29:43.422039 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 22:29:43.422039 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 22:29:43.422039 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 22:29:43.422039 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 22:29:43.422039 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 22:29:43.422039 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 22:29:43.422039 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:29:43.422039 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 22:29:43.422039 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 22:29:43.422039 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 23 22:29:43.422039 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi Jun 23 22:29:43.422039 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:29:43.422039 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi Jun 23 22:29:43.422039 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:29:43.422039 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:29:43.422039 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:29:43.423427 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:29:43.423427 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:29:43.423427 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:29:43.423427 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:29:43.423427 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 22:29:43.423427 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:29:43.423427 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 23 22:29:43.423427 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi Jun 23 22:29:43.423427 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:29:43.423427 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi Jun 23 22:29:43.423427 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:29:43.423427 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:29:43.423427 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:29:43.423427 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:29:43.423427 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:29:43.423427 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 23 22:29:43.423427 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: ERROR nova.api.openstack.wsgi Jun 23 22:29:43.423427 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-577bad6f-4f18-4b75-ae1a-90cecb927db6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:29:43.424641 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.requestlog [None req-577bad6f-4f18-4b75-ae1a-90cecb927db6 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012602 Jun 23 22:29:43.424641 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: [pid: 103357|app: 0|req: 27/52] 10.222.0.43 () {60 vars in 1193 bytes} [Thu Jun 23 22:29:43 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 22:29:44.242334 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-73822d71-4fea-45aa-8291-6da75f623d77 admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:29:44.243376 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-73822d71-4fea-45aa-8291-6da75f623d77 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jun 23 22:29:44.243769 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 26/53] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Jun 23 22:29:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:29:44.434465 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-ff531aee-e355-416b-a1c3-486c5fbb90b8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:29:44.451728 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.requestlog [None req-ff531aee-e355-416b-a1c3-486c5fbb90b8 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069225 Jun 23 22:29:44.452253 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: [pid: 103357|app: 0|req: 28/54] 10.222.0.43 () {64 vars in 1235 bytes} [Thu Jun 23 22:29:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 22:29:45.274412 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-73822d71-4fea-45aa-8291-6da75f623d77 admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:29:45.275456 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-73822d71-4fea-45aa-8291-6da75f623d77 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jun 23 22:29:45.275848 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 27/55] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Jun 23 22:29:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:29:45.473370 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-dc0a720e-6160-441d-8e1b-55ed718c6222 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:29:45.490438 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.requestlog [None req-dc0a720e-6160-441d-8e1b-55ed718c6222 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.070456 Jun 23 22:29:45.490993 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: [pid: 103357|app: 0|req: 29/56] 10.222.0.43 () {64 vars in 1235 bytes} [Thu Jun 23 22:29:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 22:29:46.374347 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-73822d71-4fea-45aa-8291-6da75f623d77 admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:29:46.375387 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-73822d71-4fea-45aa-8291-6da75f623d77 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jun 23 22:29:46.375779 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 28/57] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Jun 23 22:29:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:29:46.564523 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-f9da9af6-c080-49f9-b054-828c78766c43 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:29:46.582535 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.requestlog [None req-f9da9af6-c080-49f9-b054-828c78766c43 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.070560 Jun 23 22:29:46.583112 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: [pid: 103357|app: 0|req: 30/58] 10.222.0.43 () {64 vars in 1235 bytes} [Thu Jun 23 22:29:46 2022] POST /compute/v2.1/flavors => generated 407 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 22:29:47.403122 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-73822d71-4fea-45aa-8291-6da75f623d77 admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:29:47.404397 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-73822d71-4fea-45aa-8291-6da75f623d77 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001718 Jun 23 22:29:47.404791 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 29/59] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Jun 23 22:29:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:29:47.597335 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-d28554fa-82cc-49bf-a0fe-eb4ecec7acd2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:29:47.615036 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.requestlog [None req-d28554fa-82cc-49bf-a0fe-eb4ecec7acd2 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068724 Jun 23 22:29:47.615534 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: [pid: 103357|app: 0|req: 31/60] 10.222.0.43 () {64 vars in 1235 bytes} [Thu Jun 23 22:29:47 2022] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 22:29:48.443810 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-73822d71-4fea-45aa-8291-6da75f623d77 admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:29:48.444893 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-73822d71-4fea-45aa-8291-6da75f623d77 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001614 Jun 23 22:29:48.445292 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 30/61] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Jun 23 22:29:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:29:48.634236 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-3d40f401-6713-48e4-ae10-28a85b83e883 admin admin] Calling method '>' {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:29:48.653091 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.requestlog [None req-3d40f401-6713-48e4-ae10-28a85b83e883 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069779 Jun 23 22:29:48.653563 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: [pid: 103357|app: 0|req: 32/62] 10.222.0.43 () {60 vars in 1202 bytes} [Thu Jun 23 22:29:48 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:30:35.651486 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-73822d71-4fea-45aa-8291-6da75f623d77 admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:30:35.652731 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-73822d71-4fea-45aa-8291-6da75f623d77 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jun 23 22:30:35.653126 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 31/63] 10.222.0.43 () {54 vars in 930 bytes} [Thu Jun 23 22:30:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:30:35.664427 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG dbcounter [-] [103357] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:30:35.711298 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-9dcaeacd-0595-4b93-9e3f-ac061558b177 admin admin] Calling method '>' {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:30:35.730602 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.requestlog [None req-9dcaeacd-0595-4b93-9e3f-ac061558b177 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071046 Jun 23 22:30:35.731100 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: [pid: 103357|app: 0|req: 33/64] 10.222.0.43 () {60 vars in 1291 bytes} [Thu Jun 23 22:30:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:30:35.754343 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-b5b37d23-1729-4628-9081-58d5172f2c7b admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:30:35.757749 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG dbcounter [-] [103356] Writing DB stats nova_api:SELECT=14 {{(pid=103356) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:30:35.763766 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-b5b37d23-1729-4628-9081-58d5172f2c7b admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013533 Jun 23 22:30:35.764371 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 32/65] 10.222.0.43 () {60 vars in 1282 bytes} [Thu Jun 23 22:30:35 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:30:35.775508 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-49b94fff-de0e-47b9-902b-f3e05d41faf8 admin admin] Calling method '>' {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:30:35.784343 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.requestlog [None req-49b94fff-de0e-47b9-902b-f3e05d41faf8 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012207 Jun 23 22:30:35.784861 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: [pid: 103357|app: 0|req: 34/66] 10.222.0.43 () {60 vars in 1285 bytes} [Thu Jun 23 22:30:35 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:30:35.796029 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-b2438b31-5611-4d0e-b958-cf2fe7ed074a admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:30:35.804360 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-b2438b31-5611-4d0e-b958-cf2fe7ed074a admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011870 Jun 23 22:30:35.804864 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 33/67] 10.222.0.43 () {60 vars in 1285 bytes} [Thu Jun 23 22:30:35 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:30:35.815946 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-655bf5ce-e715-48d3-bbbd-e249153c7d30 admin admin] Calling method '>' {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:30:35.823723 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.requestlog [None req-655bf5ce-e715-48d3-bbbd-e249153c7d30 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011381 Jun 23 22:30:35.824295 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: [pid: 103357|app: 0|req: 35/68] 10.222.0.43 () {60 vars in 1282 bytes} [Thu Jun 23 22:30:35 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:33:53.025468 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-b2438b31-5611-4d0e-b958-cf2fe7ed074a admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:33:53.026471 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-b2438b31-5611-4d0e-b958-cf2fe7ed074a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jun 23 22:33:53.026884 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 34/69] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Jun 23 22:33:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:33:53.175112 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG dbcounter [-] [103357] Writing DB stats nova_api:SELECT=6 {{(pid=103357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:33:53.287928 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-9c1e3dea-bc3a-4b4c-bc71-08533b1b9a0e admin admin] Calling method '>' {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:33:53.289110 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 22:33:53.289110 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: warnings.warn(msg) Jun 23 22:33:53.290357 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG oslo_concurrency.lockutils [None req-9c1e3dea-bc3a-4b4c-bc71-08533b1b9a0e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:33:53.290802 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG oslo_concurrency.lockutils [None req-9c1e3dea-bc3a-4b4c-bc71-08533b1b9a0e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:33:53.291607 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG oslo_concurrency.lockutils [None req-9c1e3dea-bc3a-4b4c-bc71-08533b1b9a0e admin admin] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:33:53.292061 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG oslo_concurrency.lockutils [None req-9c1e3dea-bc3a-4b4c-bc71-08533b1b9a0e admin admin] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:33:53.326397 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.requestlog [None req-9c1e3dea-bc3a-4b4c-bc71-08533b1b9a0e admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.152628 Jun 23 22:33:53.327720 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: [pid: 103357|app: 0|req: 36/70] 10.222.0.43 () {60 vars in 1193 bytes} [Thu Jun 23 22:33:53 2022] GET /compute/v2.1/os-services => generated 791 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 22:33:54.172647 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-b2438b31-5611-4d0e-b958-cf2fe7ed074a admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:33:54.173649 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-b2438b31-5611-4d0e-b958-cf2fe7ed074a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Jun 23 22:33:54.174034 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 35/71] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Jun 23 22:33:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:33:54.367454 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-ee84032d-548b-4b8c-afe2-f8f6288b877c admin admin] Calling method '>' {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:33:54.369700 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 22:33:54.369700 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: warnings.warn(msg) Jun 23 22:33:54.370996 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG oslo_concurrency.lockutils [None req-ee84032d-548b-4b8c-afe2-f8f6288b877c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:33:54.371442 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG oslo_concurrency.lockutils [None req-ee84032d-548b-4b8c-afe2-f8f6288b877c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:33:54.372317 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG oslo_concurrency.lockutils [None req-ee84032d-548b-4b8c-afe2-f8f6288b877c admin admin] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:33:54.372751 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG oslo_concurrency.lockutils [None req-ee84032d-548b-4b8c-afe2-f8f6288b877c admin admin] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:33:54.392600 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.requestlog [None req-ee84032d-548b-4b8c-afe2-f8f6288b877c admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078021 Jun 23 22:33:54.393152 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: [pid: 103357|app: 0|req: 37/72] 10.222.0.43 () {60 vars in 1193 bytes} [Thu Jun 23 22:33:54 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 22:34:05.655419 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-b2438b31-5611-4d0e-b958-cf2fe7ed074a admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:34:05.656712 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-b2438b31-5611-4d0e-b958-cf2fe7ed074a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001916 Jun 23 22:34:05.657111 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 36/73] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Jun 23 22:34:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:34:05.804992 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG dbcounter [-] [103357] Writing DB stats nova_cell0:SELECT=4 {{(pid=103357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:34:05.805714 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG dbcounter [-] [103357] Writing DB stats nova_cell1:SELECT=4 {{(pid=103357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:34:05.806353 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG dbcounter [-] [103357] Writing DB stats nova_api:SELECT=8 {{(pid=103357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:34:05.854184 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-67918b64-d77e-4e1d-bc20-e1e0d8c4ed43 admin admin] Calling method '>' {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:34:05.855370 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 22:34:05.855370 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: warnings.warn(msg) Jun 23 22:34:05.856538 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG oslo_concurrency.lockutils [None req-67918b64-d77e-4e1d-bc20-e1e0d8c4ed43 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:34:05.856973 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG oslo_concurrency.lockutils [None req-67918b64-d77e-4e1d-bc20-e1e0d8c4ed43 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:34:05.857793 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG oslo_concurrency.lockutils [None req-67918b64-d77e-4e1d-bc20-e1e0d8c4ed43 admin admin] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:34:05.858216 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG oslo_concurrency.lockutils [None req-67918b64-d77e-4e1d-bc20-e1e0d8c4ed43 admin admin] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:34:05.883335 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.requestlog [None req-67918b64-d77e-4e1d-bc20-e1e0d8c4ed43 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.082595 Jun 23 22:34:05.883815 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: [pid: 103357|app: 0|req: 38/74] 10.222.0.43 () {60 vars in 1193 bytes} [Thu Jun 23 22:34:05 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:34:06.718441 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: DEBUG nova.api.openstack.wsgi [None req-b2438b31-5611-4d0e-b958-cf2fe7ed074a admin admin] Calling method '>' {{(pid=103356) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:34:06.719531 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: INFO nova.api.openstack.requestlog [None req-b2438b31-5611-4d0e-b958-cf2fe7ed074a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jun 23 22:34:06.719920 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: [pid: 103356|app: 0|req: 37/75] 10.222.0.43 () {56 vars in 1074 bytes} [Thu Jun 23 22:34:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:34:06.913392 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG nova.api.openstack.wsgi [None req-73dbf07b-ca18-4e1c-a4fd-0c40e57753dd admin admin] Calling method '>' {{(pid=103357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:34:06.914550 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 22:34:06.914550 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: warnings.warn(msg) Jun 23 22:34:06.915761 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG oslo_concurrency.lockutils [None req-73dbf07b-ca18-4e1c-a4fd-0c40e57753dd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:34:06.916202 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG oslo_concurrency.lockutils [None req-73dbf07b-ca18-4e1c-a4fd-0c40e57753dd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:34:06.916977 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG oslo_concurrency.lockutils [None req-73dbf07b-ca18-4e1c-a4fd-0c40e57753dd admin admin] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:34:06.917404 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: DEBUG oslo_concurrency.lockutils [None req-73dbf07b-ca18-4e1c-a4fd-0c40e57753dd admin admin] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:34:06.939492 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: INFO nova.api.openstack.requestlog [None req-73dbf07b-ca18-4e1c-a4fd-0c40e57753dd admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079473 Jun 23 22:34:06.939975 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: [pid: 103357|app: 0|req: 39/76] 10.222.0.43 () {60 vars in 1193 bytes} [Thu Jun 23 22:34:06 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:35:03.602160 dv-cinder-846173-2-iscsi devstack@n-api.service[103355]: Thu Jun 23 22:35:03 2022 - graceful shutdown triggered... Jun 23 22:35:03.601879 dv-cinder-846173-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 23 22:35:03.603106 dv-cinder-846173-2-iscsi devstack@n-api.service[103357]: Gracefully killing worker 2 (pid: 103357)... Jun 23 22:35:03.603535 dv-cinder-846173-2-iscsi devstack@n-api.service[103356]: Gracefully killing worker 1 (pid: 103356)... Jun 23 22:35:04.602903 dv-cinder-846173-2-iscsi devstack@n-api.service[103355]: worker 1 buried after 1 seconds Jun 23 22:35:04.603493 dv-cinder-846173-2-iscsi devstack@n-api.service[103355]: worker 2 buried after 1 seconds Jun 23 22:35:04.603493 dv-cinder-846173-2-iscsi devstack@n-api.service[103355]: goodbye to uWSGI. Jun 23 22:35:04.604536 dv-cinder-846173-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 23 22:35:04.605083 dv-cinder-846173-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 23 22:35:04.608509 dv-cinder-846173-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 23 22:35:04.617719 dv-cinder-846173-2-iscsi devstack@n-api.service[124342]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 23 22:35:04.620368 dv-cinder-846173-2-iscsi devstack@n-api.service[124342]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 23 22:35:04 2022] *** Jun 23 22:35:04.620568 dv-cinder-846173-2-iscsi devstack@n-api.service[124342]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 23 22:35:04.620734 dv-cinder-846173-2-iscsi devstack@n-api.service[124342]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 23 22:35:04.620895 dv-cinder-846173-2-iscsi devstack@n-api.service[124342]: nodename: dv-cinder-846173-2-iscsi Jun 23 22:35:04.621049 dv-cinder-846173-2-iscsi devstack@n-api.service[124342]: machine: x86_64 Jun 23 22:35:04.621201 dv-cinder-846173-2-iscsi devstack@n-api.service[124342]: clock source: unix Jun 23 22:35:04.621343 dv-cinder-846173-2-iscsi devstack@n-api.service[124342]: pcre jit disabled Jun 23 22:35:04.621485 dv-cinder-846173-2-iscsi devstack@n-api.service[124342]: detected number of CPU cores: 4 Jun 23 22:35:04.621626 dv-cinder-846173-2-iscsi devstack@n-api.service[124342]: current working directory: / Jun 23 22:35:04.621769 dv-cinder-846173-2-iscsi devstack@n-api.service[124342]: detected binary path: /usr/bin/uwsgi-core Jun 23 22:35:04.621918 dv-cinder-846173-2-iscsi devstack@n-api.service[124342]: your processes number limit is 47680 Jun 23 22:35:04.622078 dv-cinder-846173-2-iscsi devstack@n-api.service[124342]: your memory page size is 4096 bytes Jun 23 22:35:04.622229 dv-cinder-846173-2-iscsi devstack@n-api.service[124342]: detected max file descriptor number: 2048 Jun 23 22:35:04.622374 dv-cinder-846173-2-iscsi devstack@n-api.service[124342]: lock engine: pthread robust mutexes Jun 23 22:35:04.622682 dv-cinder-846173-2-iscsi devstack@n-api.service[124342]: thunder lock: enabled Jun 23 22:35:04.623044 dv-cinder-846173-2-iscsi devstack@n-api.service[124342]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 23 22:35:04.623273 dv-cinder-846173-2-iscsi devstack@n-api.service[124342]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 23 22:35:04.673719 dv-cinder-846173-2-iscsi devstack@n-api.service[124342]: Python main interpreter initialized at 0x55f94bfa69c0 Jun 23 22:35:04.673719 dv-cinder-846173-2-iscsi devstack@n-api.service[124342]: python threads support enabled Jun 23 22:35:04.673719 dv-cinder-846173-2-iscsi devstack@n-api.service[124342]: your server socket listen backlog is limited to 100 connections Jun 23 22:35:04.673719 dv-cinder-846173-2-iscsi devstack@n-api.service[124342]: your mercy for graceful operations on workers is 90 seconds Jun 23 22:35:04.674187 dv-cinder-846173-2-iscsi devstack@n-api.service[124342]: mapped 403077 bytes (393 KB) for 2 cores Jun 23 22:35:04.674187 dv-cinder-846173-2-iscsi devstack@n-api.service[124342]: *** Operational MODE: preforking *** Jun 23 22:35:04.674446 dv-cinder-846173-2-iscsi devstack@n-api.service[124342]: *** uWSGI is running in multiple interpreter mode *** Jun 23 22:35:04.674446 dv-cinder-846173-2-iscsi devstack@n-api.service[124342]: spawned uWSGI master process (pid: 124342) Jun 23 22:35:04.674654 dv-cinder-846173-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 23 22:35:04.679525 dv-cinder-846173-2-iscsi devstack@n-api.service[124342]: spawned uWSGI worker 1 (pid: 124357, cores: 1) Jun 23 22:35:04.679525 dv-cinder-846173-2-iscsi devstack@n-api.service[124342]: spawned uWSGI worker 2 (pid: 124358, cores: 1) Jun 23 22:35:04.679525 dv-cinder-846173-2-iscsi devstack@n-api.service[124342]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 23 22:35:05.353492 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 22:35:05.358557 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 22:35:06.590042 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 22:35:06.590042 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: from cryptography.utils import int_from_bytes Jun 23 22:35:06.590692 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 22:35:06.590692 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: from cryptography.utils import int_from_bytes Jun 23 22:35:06.598374 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 22:35:06.598374 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: from cryptography.utils import int_from_bytes Jun 23 22:35:06.598899 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 22:35:06.598899 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: from cryptography.utils import int_from_bytes Jun 23 22:35:09.027226 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 22:35:09.027831 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 22:35:09.027926 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 22:35:09.028842 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 22:35:09.029103 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 22:35:09.029501 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.029839 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.030172 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.030501 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.030843 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.031188 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.031788 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.032114 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.032453 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.032721 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.033062 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.033378 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846173-2-iscsi {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.033706 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.034020 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.034337 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.034665 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.034999 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.035331 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.035645 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.036159 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.037561 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.037561 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.037785 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.037997 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.038317 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.038647 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.038995 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.039315 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.039650 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.039980 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.040394 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846173-2-iscsi {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.040717 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.041026 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.041350 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.041793 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.042125 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.042427 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.042757 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.043172 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.043467 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.043793 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.044259 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.044590 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.044920 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.045231 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.045545 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.045865 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.046188 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.046503 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.046815 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.047098 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.047412 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.047740 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.048063 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.048384 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.048644 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.048899 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.049226 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.049551 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.049867 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.050188 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.050490 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.050802 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.051233 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.051539 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.052024 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.052501 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.052830 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.053156 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.053489 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.053801 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.054291 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.054736 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.054999 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.055323 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.055676 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.056000 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.056318 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.056646 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.056971 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.057284 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.057597 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.057909 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.058232 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.058576 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.058885 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.059183 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.059489 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.060503 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.061100 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.061662 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.061991 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.062312 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.062632 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.063006 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.063292 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.063610 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.063932 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.064243 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.064557 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.064873 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.065185 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.065496 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.065818 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.066143 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.066455 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.066769 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.067124 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.067437 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.067937 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.068254 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.068568 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.068896 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.069209 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.069476 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 22:35:09.069992 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.070146 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 22:35:09.070294 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.070294 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.070595 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 22:35:09.070749 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.070964 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 22:35:09.071143 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.071301 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 22:35:09.071456 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.071612 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.071769 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.071915 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.072062 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.072207 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.072382 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.072532 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.072678 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.072823 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.072978 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.073130 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.073286 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.073439 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.073612 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.073768 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.073932 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.074087 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.074266 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.074425 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.074595 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.074752 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.074914 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.075739 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846173-2-iscsi {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.075909 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.076068 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.076224 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.076398 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.076575 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.076575 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.077007 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.077186 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.077422 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.077422 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.077725 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.077882 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.078052 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.078204 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.078350 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.078350 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.078650 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.078816 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.079008 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.079162 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.079317 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.079470 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.079630 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.079801 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.079948 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.080094 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.080238 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.080397 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.080552 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.080699 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.080852 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.080999 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.081144 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.081302 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.081467 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.081623 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.081806 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.081956 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.082118 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846173-2-iscsi {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.082272 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.082417 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.082570 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.082723 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.082877 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.083074 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.083230 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.083383 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.083530 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.083729 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.083888 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.084049 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.084195 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.084348 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.084495 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.084650 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.084806 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.084953 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.085105 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.085442 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.087449 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.087710 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.087893 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.088057 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.088215 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.088363 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.088518 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.088518 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.088821 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.088969 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.089124 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.089277 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.089423 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.089582 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.089747 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.089903 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.090056 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.090205 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.090358 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.090358 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.090656 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.090804 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.091529 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.091691 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.091846 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.092002 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.092155 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.092313 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.092463 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.092616 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.092777 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.092930 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.093084 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.093229 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.093376 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.093520 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.093679 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.093880 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.094049 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.094196 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.094342 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.094496 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.094651 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.094804 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.094979 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.094979 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.095271 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.095590 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.095744 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.095891 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.096036 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.096198 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.096345 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.096505 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.096660 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.096816 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.097440 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.097610 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.097887 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.098055 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.098203 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.098357 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.098504 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.098659 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.098816 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.099099 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.099266 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.099422 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.099570 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.099753 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.099911 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.100076 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.100229 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.100431 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.100588 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.100734 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.100893 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.101059 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.101206 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.101359 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.101504 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.101650 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.101808 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.101962 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.102123 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.102268 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.102420 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.102573 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.102732 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.102915 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.103123 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.103273 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.103419 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.103564 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.103721 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.103888 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.104041 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.104187 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.104340 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.104499 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.104646 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.104807 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.104976 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.105130 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.105276 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.105276 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.105714 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.105870 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.106024 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.106179 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.106334 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.106568 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.106789 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.106973 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.107669 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.107862 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.108109 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.108262 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.108427 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.108575 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.108728 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.108875 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.109030 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.109175 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.109338 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.109492 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.109639 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.109792 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.109958 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.110113 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.110273 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.110420 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.110580 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.110733 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.110879 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.111070 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.111219 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.111373 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.111529 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.111683 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.111830 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.111830 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.112134 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.112281 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.112435 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.112591 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.112737 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.112882 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.113035 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.113189 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.113345 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.113492 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.113637 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.113819 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.114007 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.114166 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.114328 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.114481 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.114627 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.114780 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.114951 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.115121 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.115276 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.115429 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.115575 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.115908 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.116080 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.116237 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.116394 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.116549 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.116702 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.116848 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.116993 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.117153 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.117317 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.117886 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.118049 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.118302 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.118464 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.118633 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.118780 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.118989 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.119193 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.119343 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.119490 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.119646 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.119800 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.119954 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.120108 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.120262 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.120422 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.120569 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.120726 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:35:09.120726 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.121009 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.121163 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.121320 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.121474 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.121632 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.121778 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.121923 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.122108 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.122285 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.122433 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.122603 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.122752 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.122904 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.123088 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.123244 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.126887 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.127145 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.127145 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.127441 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.128083 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.128245 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.128245 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.128721 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.128883 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.129033 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.129189 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.129344 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.129490 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.129635 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.129789 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.129936 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.130129 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.130280 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.130433 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.130587 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.130740 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.131002 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.131174 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.131322 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.131469 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.131624 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.132401 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.132563 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.132716 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.132871 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.132871 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.133158 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.133347 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.133347 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.133648 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.133804 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.133949 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.134102 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.134258 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.134412 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.134558 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.134711 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.134864 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.135094 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.135291 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.135453 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.135600 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.135753 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.135900 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.136055 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.136201 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.136353 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.136506 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.136659 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.136815 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.137137 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.137300 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.137448 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.137612 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.138767 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.138979 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.139220 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.139384 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.139545 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.139699 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.139859 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.140011 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.140173 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.140333 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.140488 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.140639 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.140803 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.140971 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.141132 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.141292 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.141451 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.141612 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.141764 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.141930 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.142083 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.142243 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.142404 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.142565 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.142718 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.143498 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.143677 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.143856 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.144012 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.144165 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.144317 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.144469 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.144635 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.144804 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.144967 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.145127 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.145298 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.145459 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.145613 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.145779 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.145940 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.146093 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.146093 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.146384 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.146535 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.146697 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.147252 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.147252 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.147572 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.147751 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.147917 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.148079 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.148234 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.148983 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.149157 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.149321 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.149486 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.149649 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.149802 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.149964 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.150128 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.150282 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.150461 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.150615 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.150768 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.150938 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.151111 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.151266 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.151433 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.151595 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.151757 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.151917 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.152072 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.152072 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.152396 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.152396 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.152702 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.152863 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.153024 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.153187 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.153439 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.153698 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.153923 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.154087 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.154241 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.154404 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.154559 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.154724 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.154877 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.155050 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.155180 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.155297 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.155391 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.155489 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.155598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.155688 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.155783 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.155877 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.155964 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.156048 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.156142 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.156228 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.156320 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.156656 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.156749 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.156851 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.156946 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.157038 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.157124 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.157216 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.157305 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.157388 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.157468 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.157540 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.157624 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.157714 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.157799 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.157891 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.157977 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.158068 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.158153 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.158237 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.158320 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.158412 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.158512 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.158594 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.158678 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.158750 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.158830 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.158912 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.159010 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.159096 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.159185 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.159258 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.159415 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.159415 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.159567 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.159567 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.159717 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.159791 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.159876 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.159955 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.160034 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.160106 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.160183 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.160254 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.160338 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.160416 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.160488 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.160567 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.160639 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.160730 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.160824 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.160910 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.160993 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.161084 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.161176 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.161270 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.161355 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.161440 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.161531 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.161623 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.161715 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.161808 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.161904 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.161989 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.162073 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.162155 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.162244 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.162244 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.162417 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.162509 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.162509 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.162669 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.162753 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.162849 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.162849 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.162849 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.162849 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.162849 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.162849 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.162849 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.162849 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.163541 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.163541 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.163541 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.163541 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.163541 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.163541 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.163541 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.163541 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.164235 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.164235 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.164235 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.164235 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.164235 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.164235 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.164235 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.164235 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.164854 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.164854 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.165006 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.165098 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.165192 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.165285 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.165377 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.165462 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.165462 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.165636 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.165731 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.165817 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.165908 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.166000 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.166092 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.166177 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.166273 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.166358 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.166450 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.166541 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.166633 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.166725 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.166822 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.166914 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.167029 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.167125 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.167206 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.167304 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.167391 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.167518 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.167657 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.167794 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.167930 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.168111 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.168238 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.168421 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.168545 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.168753 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.168899 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.169811 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.169916 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.170267 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.170413 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.170753 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.170889 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.171085 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.171221 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.171437 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.171625 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.171763 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.171906 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.172039 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.172171 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.172360 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.172505 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.172689 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.172834 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.173005 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.173142 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.173329 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.173465 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.173645 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.173792 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.173944 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.174086 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.174251 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.174388 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.174565 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.174711 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.174877 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.175032 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.175215 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.175352 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.175528 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.175665 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.175839 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.175976 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.176151 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.176292 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.176477 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.176614 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.176788 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.176933 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.177094 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.177231 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.177402 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.177539 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.177707 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.177849 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.178021 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.178157 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.178343 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.178486 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.178694 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.178916 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.179095 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.179274 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.179414 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.179593 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.179850 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.179987 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.180245 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.180402 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.180536 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.180669 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.180800 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.180932 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.181071 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.181218 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.181361 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.181501 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.181670 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.181820 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.181982 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.182119 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.182288 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.182427 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.182594 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.182731 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.182915 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.183063 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.183248 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.183394 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.183559 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.183700 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.183983 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.184117 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.184299 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.184447 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.185212 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.185406 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.185800 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.185941 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.186145 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.186297 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.186462 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.186623 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.186785 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.186961 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.187124 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.187301 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.187445 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.187767 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.187903 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.188082 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.188212 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.188394 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.188524 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.188703 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.188826 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.189049 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.189180 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.189452 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.189806 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.190118 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.190468 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.190605 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.190797 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.190965 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.191292 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.191456 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.191599 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.191734 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.191881 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.192014 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.192146 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.192277 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.192409 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.192540 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.192682 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.192845 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.192984 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.193161 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.193297 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.193472 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.193697 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.193833 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.193974 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.194114 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.194236 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.194471 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.194620 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.194784 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.194948 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.195144 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.195264 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.195451 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.195575 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.195764 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.195894 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.196076 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.196205 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.196429 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.196577 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.196818 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.196965 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.197131 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.197268 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.197451 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.197582 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.197770 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.197909 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.198067 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.198204 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.198375 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.198513 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.198690 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.198828 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.199018 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.199257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.199394 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.199527 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.199659 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.199804 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.200009 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.200159 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.200323 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.200456 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.200709 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.200853 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.201034 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.201181 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.201341 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.201485 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.201664 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.201808 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.202067 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.202214 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.202377 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.202512 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.202685 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.202821 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.203021 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.203166 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.203335 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.203472 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.203647 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.203784 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.203962 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.204138 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.204281 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.204470 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.204618 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.204796 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.204946 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.205086 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.205219 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.205402 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.205538 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.205711 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.205860 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.206035 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.206172 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.206356 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.206493 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.206668 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.206813 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.206993 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.207139 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.207280 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.207413 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.207596 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.207734 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.207909 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.208053 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.208239 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.208382 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.208556 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.208694 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.208865 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.209007 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.209173 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.209325 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.209467 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.209613 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.209815 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.209943 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.210161 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.210312 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.210478 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.210622 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.210788 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.210943 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.211134 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.211288 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.211423 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.211554 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.211730 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.211876 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.212052 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.212202 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.212357 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.212500 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.212661 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.212797 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.212968 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.213116 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.213278 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.213413 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.213583 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.213725 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.213873 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.214005 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.214179 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.214315 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.214490 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.214623 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.214805 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.214997 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.215133 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.215276 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.215446 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.215590 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.215765 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.215955 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.216153 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.216291 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.216476 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.216779 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.216925 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.217064 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.217196 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.217368 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.217514 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.217656 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.217790 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.218003 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.218148 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.218316 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.218461 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.218636 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.218780 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.218987 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.219127 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.219319 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.219448 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.219674 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.219820 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.219954 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.220073 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.220296 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.220433 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.220565 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.220697 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.220825 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.220956 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.221127 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.221273 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.221454 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.221599 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.221767 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.221906 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.222075 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.222211 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.222384 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.222527 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.222691 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.222843 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.223003 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.223150 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.223316 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.223461 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.223622 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.223769 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.223925 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.224061 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.224231 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.224376 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.224552 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.224698 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.224857 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.224993 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.225180 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.225326 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.225490 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.225636 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.225795 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.225938 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.226100 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.226236 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.226405 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.226551 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.226751 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.226897 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.227084 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.227222 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.227423 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.227566 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.227745 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.227881 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.228049 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.228184 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.228364 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.228501 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.228690 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.228834 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.228999 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.229156 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.229302 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.229477 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.229622 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.229795 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.229931 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.230112 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.230276 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.230431 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.230574 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.230746 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.230963 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.231102 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.231263 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.231386 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.232244 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.232391 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.232562 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.232877 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.233013 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.233193 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.233340 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.233511 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.233753 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.233904 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.234082 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.234227 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.234398 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.234543 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.234711 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.234850 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.235059 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.235198 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.235373 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.235517 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.235687 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.235825 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.235998 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.236143 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.236309 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.236457 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.236604 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.236745 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.236914 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.237059 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.237239 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.237377 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.237560 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.237698 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.237872 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.238009 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.238200 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.238346 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.238516 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.238665 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.238831 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.239018 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.239154 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.239303 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.239523 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.239652 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.239880 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.240027 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.240198 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.240335 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.240506 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.240643 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.240821 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.240972 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.241121 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.241253 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.241424 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.241567 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.241735 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.241870 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.242043 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.242187 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.242353 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.242489 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.242664 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.242806 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.242994 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.243142 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.243306 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.243443 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.243613 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.243763 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.243922 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.244063 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.244236 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.244379 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.244563 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.244714 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.244878 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.245016 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.245187 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.245323 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.245500 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.245717 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.245859 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.246000 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.246133 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.246321 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.246473 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.246638 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.246775 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.246993 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.247182 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.247902 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.248058 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.248232 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.248534 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.248691 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.248856 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.248994 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.249181 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.249324 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.249489 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.249633 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.249795 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.249933 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.250106 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.250244 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.250417 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.250548 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.250721 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.250872 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.251063 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.251202 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.251374 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.251518 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.251660 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.251803 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.251982 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.252119 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.252291 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.252427 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.252683 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.252827 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.252993 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.253156 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.253300 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.253473 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.253610 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.253798 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.253935 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.254120 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.254264 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.254439 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.254585 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.254729 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.254864 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.255078 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.255229 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.255370 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.255517 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.255680 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.255824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.255996 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.256141 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.256308 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.256459 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.256599 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.256732 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.256904 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.257048 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.257214 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.257365 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.257521 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.257665 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.257827 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.257967 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.258138 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.258275 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.258446 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.258582 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.258771 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.258907 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.259100 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.259246 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.259408 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.259553 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.259714 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.259850 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.260027 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.260171 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.260333 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.260478 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.260640 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.260777 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.260946 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.261091 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.261250 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.261393 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.261560 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.261711 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.261865 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.262001 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.262174 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.262310 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.262480 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.262617 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.262845 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.263099 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.263270 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.263549 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.263896 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.264264 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.264406 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.264590 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.264727 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.264899 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.265043 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.265209 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.265355 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.265527 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.265661 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.265837 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.265984 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.266151 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.266294 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.266462 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.266596 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.266776 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.266946 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.267120 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.267258 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.267453 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.267588 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.267778 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.267991 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.268136 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.268328 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.268473 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.268656 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.268806 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.268989 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.269126 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.269320 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.269465 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.269626 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.269771 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.269933 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.270085 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.270313 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.270628 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.271415 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.271544 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.271666 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.271763 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.271851 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.271950 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.272041 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.272134 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.272227 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.272487 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.272589 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.272801 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.272894 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.273117 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.273211 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.273430 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.273531 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.273747 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.273841 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.274062 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.274156 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.274389 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.274493 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.274727 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.274821 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.275078 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.275327 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.275447 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.275669 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.275776 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.275999 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.276103 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.276333 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.276526 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.276787 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.276951 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.277108 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.277322 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.277483 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.277639 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.277797 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.278138 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.278330 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.278654 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.279049 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.279205 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.279205 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.279481 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.279632 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.279774 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.279935 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.280087 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.280227 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.280380 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.280472 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.280567 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.280567 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.280722 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.280904 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.281158 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.281264 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.281774 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.281947 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.282099 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.282278 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.282416 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.282610 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.282962 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.283070 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.283290 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.283393 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.283625 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.283719 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.283961 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.284063 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.284282 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.284387 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.284604 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.284703 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.284920 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.285017 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.285249 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.285402 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.285564 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.285660 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.285878 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.285977 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.286201 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.286304 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.286521 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.286614 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.286832 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.286940 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.287169 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.287274 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.287488 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.287581 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.287804 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.287904 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.288114 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.288209 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.288431 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.288531 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.288738 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.288839 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.289057 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.289164 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.289369 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.289461 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.289680 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.289773 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.289990 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.290091 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.290312 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.290458 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.290622 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.290772 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.290963 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.291104 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.291269 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.291411 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.291578 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.291733 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.291896 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.292049 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.292206 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.292364 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.292521 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.292677 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.292832 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.292997 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.293146 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.293309 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.293455 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.293623 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.293767 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.294463 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.294849 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.295044 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.295240 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.295470 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.295642 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.295806 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.295903 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.296021 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.296153 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.296349 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.296488 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.296671 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.296809 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.297003 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.297141 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.297326 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.297461 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.297647 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.297796 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.297999 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.298131 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.298325 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.298457 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.298779 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.298871 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.299146 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.299251 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.299465 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.299560 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.299789 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.299891 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.300110 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.300205 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.300433 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.300531 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.300782 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.300924 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.301100 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.301202 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.301427 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.301527 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.301745 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.301866 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.302062 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.302183 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.302376 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.302518 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.302694 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.302834 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.303033 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.303186 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.303350 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.303511 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.303663 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.303834 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.303977 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.304173 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.304295 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.304494 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.304609 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.304926 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.305082 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.305239 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.305333 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.305551 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.305704 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.305870 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.305973 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.306217 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.306313 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.306542 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.306644 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.306864 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.306989 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.307251 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.307351 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.307571 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.307750 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.307890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.307982 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.308206 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.308300 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.308521 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.308621 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.308836 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.308938 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.309156 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.309249 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.309489 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.309649 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.309881 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.310075 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.310296 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.310445 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.310555 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.310760 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 22:35:09.310904 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.311254 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.311580 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.311906 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.312223 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.312548 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.312892 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.313191 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.313516 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.313829 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.314164 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.314507 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.314839 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.315195 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.315508 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.315820 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.316130 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.316442 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.316764 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.317078 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.317389 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.317701 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.318016 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.318325 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.318635 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.318961 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.319274 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.319588 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.319898 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.320207 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.320514 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.320828 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.321135 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.321444 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.321754 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.322060 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.322366 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.322671 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.323000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.323309 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.323640 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.323975 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.324295 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.324620 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.324934 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.326000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.326544 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.326889 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.327255 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.327583 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.327901 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.328240 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.328557 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.328874 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.329191 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.329505 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.329818 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.330133 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.330463 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.330825 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.331165 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.331506 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.331826 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.332147 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.332466 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.332780 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.333112 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.333427 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.333739 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.334056 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.334368 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.334681 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.335019 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.335337 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.335667 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.336006 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.336310 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.336636 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.336963 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.337308 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.337623 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.337968 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.338296 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.338613 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.339062 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.339258 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:35:09.339501 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 22:35:09.375126 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO dbcounter [None req-9f70bfc9-4e7c-4743-bb25-c54d95141d2c None None] Registered counter for database nova_api Jun 23 22:35:09.396268 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_db.sqlalchemy.engines [None req-9f70bfc9-4e7c-4743-bb25-c54d95141d2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 22:35:09.404875 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writer thread running {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 22:35:09.405057 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO dbcounter [None req-2c90448e-c2c4-46ac-b5c9-6666d846d261 None None] Registered counter for database nova_api Jun 23 22:35:09.426410 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_db.sqlalchemy.engines [None req-2c90448e-c2c4-46ac-b5c9-6666d846d261 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124357) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 22:35:09.433029 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writer thread running {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 22:35:09.462600 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.context [None req-9f70bfc9-4e7c-4743-bb25-c54d95141d2c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),153e4b5e-85be-4e7e-b870-de4fc67764a6(cell1) {{(pid=124358) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 22:35:09.467045 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9f70bfc9-4e7c-4743-bb25-c54d95141d2c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:35:09.468666 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9f70bfc9-4e7c-4743-bb25-c54d95141d2c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:35:09.469484 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9f70bfc9-4e7c-4743-bb25-c54d95141d2c None None] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:35:09.471550 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9f70bfc9-4e7c-4743-bb25-c54d95141d2c None None] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:35:09.473551 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO dbcounter [None req-9f70bfc9-4e7c-4743-bb25-c54d95141d2c None None] Registered counter for database nova_cell0 Jun 23 22:35:09.477647 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO dbcounter [None req-9f70bfc9-4e7c-4743-bb25-c54d95141d2c None None] Registered counter for database nova_cell1 Jun 23 22:35:09.485840 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_db.sqlalchemy.engines [None req-9f70bfc9-4e7c-4743-bb25-c54d95141d2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 22:35:09.487839 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_db.sqlalchemy.engines [None req-9f70bfc9-4e7c-4743-bb25-c54d95141d2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 22:35:09.492411 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.context [None req-2c90448e-c2c4-46ac-b5c9-6666d846d261 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),153e4b5e-85be-4e7e-b870-de4fc67764a6(cell1) {{(pid=124357) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 22:35:09.495646 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writer thread running {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 22:35:09.495986 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writer thread running {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 22:35:09.496567 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2c90448e-c2c4-46ac-b5c9-6666d846d261 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:35:09.499234 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2c90448e-c2c4-46ac-b5c9-6666d846d261 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:35:09.500053 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2c90448e-c2c4-46ac-b5c9-6666d846d261 None None] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:35:09.502018 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2c90448e-c2c4-46ac-b5c9-6666d846d261 None None] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:35:09.504046 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO dbcounter [None req-2c90448e-c2c4-46ac-b5c9-6666d846d261 None None] Registered counter for database nova_cell0 Jun 23 22:35:09.508065 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO dbcounter [None req-2c90448e-c2c4-46ac-b5c9-6666d846d261 None None] Registered counter for database nova_cell1 Jun 23 22:35:09.515834 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_db.sqlalchemy.engines [None req-2c90448e-c2c4-46ac-b5c9-6666d846d261 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124357) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 22:35:09.517542 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_db.sqlalchemy.engines [None req-2c90448e-c2c4-46ac-b5c9-6666d846d261 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124357) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 22:35:09.524829 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writer thread running {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 22:35:09.525171 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writer thread running {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 22:35:09.647661 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO dbcounter [None req-9f70bfc9-4e7c-4743-bb25-c54d95141d2c None None] Registered counter for database nova_cell0 Jun 23 22:35:09.654981 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_db.sqlalchemy.engines [None req-9f70bfc9-4e7c-4743-bb25-c54d95141d2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 22:35:09.659872 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writer thread running {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 22:35:09.677094 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO dbcounter [None req-2c90448e-c2c4-46ac-b5c9-6666d846d261 None None] Registered counter for database nova_cell0 Jun 23 22:35:09.683695 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_db.sqlalchemy.engines [None req-2c90448e-c2c4-46ac-b5c9-6666d846d261 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124357) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 22:35:09.689202 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writer thread running {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 22:35:10.007156 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: WARNING keystonemiddleware.auth_token [None req-9f70bfc9-4e7c-4743-bb25-c54d95141d2c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 22:35:10.015927 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: WARNING keystonemiddleware.auth_token [None req-9f70bfc9-4e7c-4743-bb25-c54d95141d2c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 22:35:10.017612 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: WARNING keystonemiddleware.auth_token [None req-2c90448e-c2c4-46ac-b5c9-6666d846d261 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 22:35:10.026607 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: WARNING keystonemiddleware.auth_token [None req-2c90448e-c2c4-46ac-b5c9-6666d846d261 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 22:35:10.371799 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: WARNING keystonemiddleware.auth_token [None req-9f70bfc9-4e7c-4743-bb25-c54d95141d2c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 22:35:10.378169 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: WARNING keystonemiddleware.auth_token [None req-2c90448e-c2c4-46ac-b5c9-6666d846d261 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 22:35:10.379036 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: WARNING keystonemiddleware.auth_token [None req-9f70bfc9-4e7c-4743-bb25-c54d95141d2c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 22:35:10.384232 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: WARNING keystonemiddleware.auth_token [None req-2c90448e-c2c4-46ac-b5c9-6666d846d261 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 22:35:10.384374 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f94bfa69c0 pid: 124358 (default app) Jun 23 22:35:10.390211 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f94bfa69c0 pid: 124357 (default app) Jun 23 22:35:50.938592 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=3 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:35:50.939555 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=3 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:35:50.940206 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=3 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:35:50.940934 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=3 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:35:51.502319 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_api:SELECT=3 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:35:51.503168 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell1:SELECT=3 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:35:51.503996 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell0:SELECT=3 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:35:51.507764 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell0:SELECT=3 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:35:52.818432 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d0d821fd-ae21-4270-863b-88ea0c394563 tempest-VolumesGetTestJSON-1542543254 tempest-VolumesGetTestJSON-1542543254-project] Action: 'create', calling method: .version_select at 0x7fb71b6fa700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1863171469", "metadata": {"Type": "work"}}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:35:53.124249 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-3b2c3158-255f-4527-96dd-e5c20ac5a213 tempest-VolumesNegativeTest-762996238 tempest-VolumesNegativeTest-762996238-project] Action: 'create', calling method: .version_select at 0x7fb71b6fb700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-132667314", "metadata": {"Type": "work"}}} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:35:53.156477 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-3b2c3158-255f-4527-96dd-e5c20ac5a213 tempest-VolumesNegativeTest-762996238 tempest-VolumesNegativeTest-762996238-project] Request method failure captured: Jun 23 22:35:53.156477 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 23 22:35:53.156477 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept: application/json Jun 23 22:35:53.156477 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept-Encoding: identity Jun 23 22:35:53.156477 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Connection: close Jun 23 22:35:53.156477 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Length: 121 Jun 23 22:35:53.156477 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Type: application/json Jun 23 22:35:53.156477 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Host: 10.222.0.43 Jun 23 22:35:53.156477 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Openstack-System-Scope: None Jun 23 22:35:53.156477 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: User-Agent: python-urllib3/1.26.9 Jun 23 22:35:53.156477 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Auth-Token: gAAAAABitOrHWmoi-ePLNMft5tgpAY06i6b2IQhH9W_88lf7AW6Ww9nz819dhPhEG8cbeSlI0JZkGNe41IKDu38NvL3Wh0DSnvZh2jbONmkwoh6A7RE6EmU61iwHpBCA2xcJOQ1jFR9p_Cy0J_baDK0-nOYae57tIQsu2aI8KzT6DIpizuoQdCc Jun 23 22:35:53.156477 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Id: None Jun 23 22:35:53.156477 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Name: None Jun 23 22:35:53.156477 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Identity-Status: Confirmed Jun 23 22:35:53.156477 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Is-Admin-Project: True Jun 23 22:35:53.156477 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Id: default Jun 23 22:35:53.156477 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Name: Default Jun 23 22:35:53.156477 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Id: 2d484d9303ed401fbd838f2c6bb9c04d Jun 23 22:35:53.156477 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Name: tempest-VolumesNegativeTest-762996238 Jun 23 22:35:53.156477 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Role: reader,member Jun 23 22:35:53.156477 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Roles: reader,member Jun 23 22:35:53.158213 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2d484d9303ed401fbd838f2c6bb9c04d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2d484d9303ed401fbd838f2c6bb9c04d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2d484d9303ed401fbd838f2c6bb9c04d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2d484d9303ed401fbd838f2c6bb9c04d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:35:53.158213 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant: tempest-VolumesNegativeTest-762996238 Jun 23 22:35:53.158213 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Id: 2d484d9303ed401fbd838f2c6bb9c04d Jun 23 22:35:53.158213 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Name: tempest-VolumesNegativeTest-762996238 Jun 23 22:35:53.158213 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User: tempest-VolumesNegativeTest-762996238-project Jun 23 22:35:53.158213 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Id: default Jun 23 22:35:53.158213 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Name: Default Jun 23 22:35:53.158213 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Id: ea3c44869fe74d628b8dd5ecd0c22485 Jun 23 22:35:53.158213 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Name: tempest-VolumesNegativeTest-762996238-project Jun 23 22:35:53.158213 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Jun 23 22:35:53.158213 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-132667314", "metadata": {"Type": "work"}}} Jun 23 22:35:53.158213 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: method: Jun 23 22:35:53.158213 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 23 22:35:53.165396 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-132667314', 'metadata': {'Type': 'work'}}}} Jun 23 22:35:53.165396 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:35:53.165396 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:35:53.165396 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 23 22:35:53.165396 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 23 22:35:53.165396 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 23 22:35:53.165396 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise error Jun 23 22:35:53.165396 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 23 22:35:53.165396 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:53.165396 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 23 22:35:53.165396 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 23 22:35:53.165396 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:53.165396 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 23 22:35:53.165396 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi '#$%' Jun 23 22:35:53.165396 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:53.165396 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:35:53.165396 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:53.165396 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:35:53.165396 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:35:53.165396 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:35:53.165396 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:35:53.165396 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:35:53.167987 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 22:35:53.167987 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 22:35:53.167987 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:35:53.167987 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:35:53.167987 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 23 22:35:53.167987 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 23 22:35:53.167987 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 23 22:35:53.167987 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 23 22:35:53.167987 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 23 22:35:53.167987 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 23 22:35:53.167987 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 23 22:35:53.167987 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:53.167987 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:35:53.167987 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:53.167987 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:35:53.167987 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:35:53.167987 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:35:53.167987 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 23 22:35:53.167987 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 23 22:35:53.171629 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 23 22:35:53.171629 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:53.171629 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-3b2c3158-255f-4527-96dd-e5c20ac5a213 tempest-VolumesNegativeTest-762996238 tempest-VolumesNegativeTest-762996238-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:35:53.171629 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-3b2c3158-255f-4527-96dd-e5c20ac5a213 tempest-VolumesNegativeTest-762996238 tempest-VolumesNegativeTest-762996238-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.662709 Jun 23 22:35:53.171629 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 1/1] 10.222.0.43 () {60 vars in 1155 bytes} [Thu Jun 23 22:35:51 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1665 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 22:35:53.171629 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-40093e5c-6e5f-456a-97df-8ffc516727b1 tempest-VolumesNegativeTest-762996238 tempest-VolumesNegativeTest-762996238-project] Action: 'create', calling method: .version_select at 0x7fb71b67a9d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-465936383", "metadata": {"Type": "work"}}} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:35:53.174215 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-40093e5c-6e5f-456a-97df-8ffc516727b1 tempest-VolumesNegativeTest-762996238 tempest-VolumesNegativeTest-762996238-project] Request method failure captured: Jun 23 22:35:53.174215 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 23 22:35:53.174215 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept: application/json Jun 23 22:35:53.174215 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept-Encoding: identity Jun 23 22:35:53.174215 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Connection: close Jun 23 22:35:53.174215 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Length: 119 Jun 23 22:35:53.174215 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Type: application/json Jun 23 22:35:53.174215 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Host: 10.222.0.43 Jun 23 22:35:53.174215 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Openstack-System-Scope: None Jun 23 22:35:53.174215 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: User-Agent: python-urllib3/1.26.9 Jun 23 22:35:53.174215 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Auth-Token: gAAAAABitOrHWmoi-ePLNMft5tgpAY06i6b2IQhH9W_88lf7AW6Ww9nz819dhPhEG8cbeSlI0JZkGNe41IKDu38NvL3Wh0DSnvZh2jbONmkwoh6A7RE6EmU61iwHpBCA2xcJOQ1jFR9p_Cy0J_baDK0-nOYae57tIQsu2aI8KzT6DIpizuoQdCc Jun 23 22:35:53.174215 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Id: None Jun 23 22:35:53.174215 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Name: None Jun 23 22:35:53.174215 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Identity-Status: Confirmed Jun 23 22:35:53.174215 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Is-Admin-Project: True Jun 23 22:35:53.174215 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Id: default Jun 23 22:35:53.174215 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Name: Default Jun 23 22:35:53.174215 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Id: 2d484d9303ed401fbd838f2c6bb9c04d Jun 23 22:35:53.174215 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Name: tempest-VolumesNegativeTest-762996238 Jun 23 22:35:53.174215 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Role: reader,member Jun 23 22:35:53.174215 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Roles: reader,member Jun 23 22:35:53.175559 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2d484d9303ed401fbd838f2c6bb9c04d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2d484d9303ed401fbd838f2c6bb9c04d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2d484d9303ed401fbd838f2c6bb9c04d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2d484d9303ed401fbd838f2c6bb9c04d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:35:53.175559 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant: tempest-VolumesNegativeTest-762996238 Jun 23 22:35:53.175559 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Id: 2d484d9303ed401fbd838f2c6bb9c04d Jun 23 22:35:53.175559 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Name: tempest-VolumesNegativeTest-762996238 Jun 23 22:35:53.175559 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User: tempest-VolumesNegativeTest-762996238-project Jun 23 22:35:53.175559 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Id: default Jun 23 22:35:53.175559 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Name: Default Jun 23 22:35:53.175559 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Id: ea3c44869fe74d628b8dd5ecd0c22485 Jun 23 22:35:53.175559 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Name: tempest-VolumesNegativeTest-762996238-project Jun 23 22:35:53.175559 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Jun 23 22:35:53.175559 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-465936383", "metadata": {"Type": "work"}}} Jun 23 22:35:53.175559 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: method: Jun 23 22:35:53.175559 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 23 22:35:53.176342 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-465936383', 'metadata': {'Type': 'work'}}}} Jun 23 22:35:53.176342 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:35:53.176342 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:35:53.176342 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 23 22:35:53.176342 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 23 22:35:53.176342 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 23 22:35:53.176342 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise error Jun 23 22:35:53.176342 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 23 22:35:53.176342 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:53.176342 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 23 22:35:53.176342 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 23 22:35:53.176342 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:53.176342 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 23 22:35:53.176342 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi '0' Jun 23 22:35:53.176342 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:53.176342 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:35:53.176342 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:53.176342 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:35:53.176342 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:35:53.176342 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:35:53.176342 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:35:53.176342 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:35:53.177915 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 22:35:53.177915 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 22:35:53.177915 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:35:53.177915 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:35:53.177915 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 23 22:35:53.177915 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 23 22:35:53.177915 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 23 22:35:53.177915 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 23 22:35:53.177915 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 23 22:35:53.177915 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 23 22:35:53.177915 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 23 22:35:53.177915 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:53.177915 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:35:53.177915 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:53.177915 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:35:53.177915 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:35:53.177915 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:35:53.177915 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 23 22:35:53.177915 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 23 22:35:53.179130 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 23 22:35:53.179130 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:53.181334 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-40093e5c-6e5f-456a-97df-8ffc516727b1 tempest-VolumesNegativeTest-762996238 tempest-VolumesNegativeTest-762996238-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:35:53.182484 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-40093e5c-6e5f-456a-97df-8ffc516727b1 tempest-VolumesNegativeTest-762996238 tempest-VolumesNegativeTest-762996238-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.015876 Jun 23 22:35:53.183731 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 2/2] 10.222.0.43 () {60 vars in 1155 bytes} [Thu Jun 23 22:35:53 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 22:35:53.193676 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-b303dc94-7ff8-4e1a-a065-39549c33f6cd tempest-VolumesNegativeTest-762996238 tempest-VolumesNegativeTest-762996238-project] Action: 'create', calling method: .version_select at 0x7fb71b6fba60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1434542792", "metadata": {"Type": "work"}}} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:35:53.196630 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-b303dc94-7ff8-4e1a-a065-39549c33f6cd tempest-VolumesNegativeTest-762996238 tempest-VolumesNegativeTest-762996238-project] Request method failure captured: Jun 23 22:35:53.196630 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 23 22:35:53.196630 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept: application/json Jun 23 22:35:53.196630 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept-Encoding: identity Jun 23 22:35:53.196630 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Connection: close Jun 23 22:35:53.196630 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Length: 119 Jun 23 22:35:53.196630 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Type: application/json Jun 23 22:35:53.196630 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Host: 10.222.0.43 Jun 23 22:35:53.196630 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Openstack-System-Scope: None Jun 23 22:35:53.196630 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: User-Agent: python-urllib3/1.26.9 Jun 23 22:35:53.196630 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Auth-Token: gAAAAABitOrHWmoi-ePLNMft5tgpAY06i6b2IQhH9W_88lf7AW6Ww9nz819dhPhEG8cbeSlI0JZkGNe41IKDu38NvL3Wh0DSnvZh2jbONmkwoh6A7RE6EmU61iwHpBCA2xcJOQ1jFR9p_Cy0J_baDK0-nOYae57tIQsu2aI8KzT6DIpizuoQdCc Jun 23 22:35:53.196630 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Id: None Jun 23 22:35:53.196630 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Name: None Jun 23 22:35:53.196630 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Identity-Status: Confirmed Jun 23 22:35:53.196630 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Is-Admin-Project: True Jun 23 22:35:53.196630 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Id: default Jun 23 22:35:53.196630 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Name: Default Jun 23 22:35:53.196630 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Id: 2d484d9303ed401fbd838f2c6bb9c04d Jun 23 22:35:53.196630 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Name: tempest-VolumesNegativeTest-762996238 Jun 23 22:35:53.196630 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Role: reader,member Jun 23 22:35:53.196630 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Roles: reader,member Jun 23 22:35:53.197910 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2d484d9303ed401fbd838f2c6bb9c04d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2d484d9303ed401fbd838f2c6bb9c04d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2d484d9303ed401fbd838f2c6bb9c04d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2d484d9303ed401fbd838f2c6bb9c04d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:35:53.197910 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant: tempest-VolumesNegativeTest-762996238 Jun 23 22:35:53.197910 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Id: 2d484d9303ed401fbd838f2c6bb9c04d Jun 23 22:35:53.197910 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Name: tempest-VolumesNegativeTest-762996238 Jun 23 22:35:53.197910 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User: tempest-VolumesNegativeTest-762996238-project Jun 23 22:35:53.197910 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Id: default Jun 23 22:35:53.197910 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Name: Default Jun 23 22:35:53.197910 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Id: ea3c44869fe74d628b8dd5ecd0c22485 Jun 23 22:35:53.197910 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Name: tempest-VolumesNegativeTest-762996238-project Jun 23 22:35:53.197910 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Jun 23 22:35:53.197910 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1434542792", "metadata": {"Type": "work"}}} Jun 23 22:35:53.197910 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: method: Jun 23 22:35:53.197910 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 23 22:35:53.198682 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1434542792', 'metadata': {'Type': 'work'}}}} Jun 23 22:35:53.198682 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:35:53.198682 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:35:53.198682 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 23 22:35:53.198682 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 23 22:35:53.198682 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 23 22:35:53.198682 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise error Jun 23 22:35:53.198682 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 23 22:35:53.198682 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:53.198682 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 23 22:35:53.198682 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 23 22:35:53.198682 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:53.198682 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 23 22:35:53.198682 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi '' Jun 23 22:35:53.198682 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:53.198682 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:35:53.198682 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:53.198682 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:35:53.198682 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:35:53.198682 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:35:53.198682 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:35:53.198682 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:35:53.199997 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 22:35:53.199997 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 22:35:53.199997 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:35:53.199997 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:35:53.199997 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 23 22:35:53.199997 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 23 22:35:53.199997 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 23 22:35:53.199997 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 23 22:35:53.199997 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 23 22:35:53.199997 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 23 22:35:53.199997 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 23 22:35:53.199997 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:53.199997 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:35:53.199997 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:53.199997 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:35:53.199997 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:35:53.199997 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:35:53.199997 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 23 22:35:53.199997 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 23 22:35:53.203254 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 23 22:35:53.203254 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:53.205317 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-b303dc94-7ff8-4e1a-a065-39549c33f6cd tempest-VolumesNegativeTest-762996238 tempest-VolumesNegativeTest-762996238-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:35:53.206575 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-b303dc94-7ff8-4e1a-a065-39549c33f6cd tempest-VolumesNegativeTest-762996238 tempest-VolumesNegativeTest-762996238-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017267 Jun 23 22:35:53.209003 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 3/3] 10.222.0.43 () {60 vars in 1155 bytes} [Thu Jun 23 22:35:53 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 22:35:53.219219 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-2ad0cb3f-e76c-49b6-84ed-6270c1d1d3d6 tempest-VolumesNegativeTest-762996238 tempest-VolumesNegativeTest-762996238-project] Calling method '.version_select at 0x7fb71b5a3670>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:35:53.587882 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.wsgi [None req-2ad0cb3f-e76c-49b6-84ed-6270c1d1d3d6 tempest-VolumesNegativeTest-762996238 tempest-VolumesNegativeTest-762996238-project] HTTP exception thrown: Volume tempest-invalid-601758027 could not be found. Jun 23 22:35:53.592004 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-2ad0cb3f-e76c-49b6-84ed-6270c1d1d3d6 tempest-VolumesNegativeTest-762996238 tempest-VolumesNegativeTest-762996238-project] Request method failure captured: Jun 23 22:35:53.592004 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-601758027 HTTP/1.1 Jun 23 22:35:53.592004 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept: application/json Jun 23 22:35:53.592004 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept-Encoding: identity Jun 23 22:35:53.592004 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Connection: close Jun 23 22:35:53.592004 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Length: 0 Jun 23 22:35:53.592004 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Type: application/json Jun 23 22:35:53.592004 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Host: 10.222.0.43 Jun 23 22:35:53.592004 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Openstack-System-Scope: None Jun 23 22:35:53.592004 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: User-Agent: python-urllib3/1.26.9 Jun 23 22:35:53.592004 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Auth-Token: gAAAAABitOrHWmoi-ePLNMft5tgpAY06i6b2IQhH9W_88lf7AW6Ww9nz819dhPhEG8cbeSlI0JZkGNe41IKDu38NvL3Wh0DSnvZh2jbONmkwoh6A7RE6EmU61iwHpBCA2xcJOQ1jFR9p_Cy0J_baDK0-nOYae57tIQsu2aI8KzT6DIpizuoQdCc Jun 23 22:35:53.592004 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Id: None Jun 23 22:35:53.592004 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Name: None Jun 23 22:35:53.592004 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Identity-Status: Confirmed Jun 23 22:35:53.592004 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Is-Admin-Project: True Jun 23 22:35:53.592004 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Id: default Jun 23 22:35:53.592004 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Name: Default Jun 23 22:35:53.592004 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Id: 2d484d9303ed401fbd838f2c6bb9c04d Jun 23 22:35:53.592004 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Name: tempest-VolumesNegativeTest-762996238 Jun 23 22:35:53.592004 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Role: reader,member Jun 23 22:35:53.592004 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Roles: reader,member Jun 23 22:35:53.593700 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2d484d9303ed401fbd838f2c6bb9c04d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2d484d9303ed401fbd838f2c6bb9c04d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2d484d9303ed401fbd838f2c6bb9c04d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2d484d9303ed401fbd838f2c6bb9c04d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:35:53.593700 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant: tempest-VolumesNegativeTest-762996238 Jun 23 22:35:53.593700 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Id: 2d484d9303ed401fbd838f2c6bb9c04d Jun 23 22:35:53.593700 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Name: tempest-VolumesNegativeTest-762996238 Jun 23 22:35:53.593700 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User: tempest-VolumesNegativeTest-762996238-project Jun 23 22:35:53.593700 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Id: default Jun 23 22:35:53.593700 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Name: Default Jun 23 22:35:53.593700 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Id: ea3c44869fe74d628b8dd5ecd0c22485 Jun 23 22:35:53.593700 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Name: tempest-VolumesNegativeTest-762996238-project Jun 23 22:35:53.593700 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: method: Jun 23 22:35:53.593700 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: exception: Volume tempest-invalid-601758027 could not be found. Jun 23 22:35:53.593700 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: action_args: {'id': 'tempest-invalid-601758027'} Jun 23 22:35:53.593700 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:35:53.599319 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:35:53.599319 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 22:35:53.599319 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 22:35:53.599319 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 22:35:53.599319 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 22:35:53.599319 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 22:35:53.599319 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 22:35:53.599319 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 22:35:53.599319 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 22:35:53.599319 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 22:35:53.599319 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 22:35:53.599319 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 22:35:53.599319 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 22:35:53.599319 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 22:35:53.599319 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 22:35:53.599319 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-601758027 could not be found. (HTTP 404) (Request-ID: req-c3df7607-8a9e-4eaf-9719-3639ff96ace7) Jun 23 22:35:53.599319 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:53.599319 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:35:53.599319 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:53.600487 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:35:53.600487 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 23 22:35:53.600487 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 23 22:35:53.600487 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 22:35:53.600487 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 22:35:53.600487 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 22:35:53.600487 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 22:35:53.600487 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 22:35:53.600487 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 22:35:53.600487 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 22:35:53.600487 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 22:35:53.600487 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 22:35:53.600487 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 22:35:53.600487 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 22:35:53.600487 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 22:35:53.600487 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 22:35:53.600487 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 22:35:53.600487 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 22:35:53.600487 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 22:35:53.601601 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 22:35:53.601601 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 22:35:53.601601 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 22:35:53.601601 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 22:35:53.601601 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-601758027 could not be found. Jun 23 22:35:53.601601 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:53.601601 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:35:53.601601 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:53.601601 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:35:53.601601 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:35:53.601601 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:35:53.601601 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:35:53.601601 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:35:53.601601 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 22:35:53.601601 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 22:35:53.601601 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:35:53.601601 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:35:53.601601 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 23 22:35:53.601601 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:35:53.601601 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-601758027 could not be found. Jun 23 22:35:53.603788 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:53.603788 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:35:53.603788 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:53.603788 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:35:53.603788 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:35:53.603788 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:35:53.603788 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:35:53.603788 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:35:53.603788 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-601758027 could not be found. Jun 23 22:35:53.603788 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:53.603788 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-2ad0cb3f-e76c-49b6-84ed-6270c1d1d3d6 tempest-VolumesNegativeTest-762996238 tempest-VolumesNegativeTest-762996238-project] Returning 404 to user: Volume tempest-invalid-601758027 could not be found. {{(pid=124357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:35:53.603788 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-2ad0cb3f-e76c-49b6-84ed-6270c1d1d3d6 tempest-VolumesNegativeTest-762996238 tempest-VolumesNegativeTest-762996238-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/tempest-invalid-601758027" status: 404 len: 98 microversion: 2.1 time: 0.379946 Jun 23 22:35:53.603788 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 4/4] 10.222.0.43 () {58 vars in 1214 bytes} [Thu Jun 23 22:35:53 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-601758027 => generated 98 bytes in 381 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 23 22:35:53.610958 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-eab9bea8-f712-49ea-8b59-a4dd0711b00b tempest-VolumesNegativeTest-762996238 tempest-VolumesNegativeTest-762996238-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004164 Jun 23 22:35:53.610958 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 5/5] 10.222.0.43 () {58 vars in 1139 bytes} [Thu Jun 23 22:35:53 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 23 22:35:53.641610 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-472c7513-9d09-4c0c-82ab-6687e16f4d42 tempest-VolumesNegativeTest-762996238 tempest-VolumesNegativeTest-762996238-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.023875 Jun 23 22:35:53.642283 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 6/6] 10.222.0.43 () {58 vars in 1136 bytes} [Thu Jun 23 22:35:53 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 23 22:35:53.662398 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-9d4887cb-1a5a-46e0-9033-dc205062ca3f tempest-VolumesNegativeTest-762996238 tempest-VolumesNegativeTest-762996238-project] Calling method '.version_select at 0x7fb71b554a60>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:35:53.863750 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.wsgi [None req-9d4887cb-1a5a-46e0-9033-dc205062ca3f tempest-VolumesNegativeTest-762996238 tempest-VolumesNegativeTest-762996238-project] HTTP exception thrown: Volume f7d34cbf-de63-41bc-a9d4-ab04551b422e could not be found. Jun 23 22:35:53.867134 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-9d4887cb-1a5a-46e0-9033-dc205062ca3f tempest-VolumesNegativeTest-762996238 tempest-VolumesNegativeTest-762996238-project] Request method failure captured: Jun 23 22:35:53.867134 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: request: DELETE /compute/v2.1/os-volumes/f7d34cbf-de63-41bc-a9d4-ab04551b422e HTTP/1.1 Jun 23 22:35:53.867134 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept: application/json Jun 23 22:35:53.867134 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept-Encoding: identity Jun 23 22:35:53.867134 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Connection: close Jun 23 22:35:53.867134 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Length: 0 Jun 23 22:35:53.867134 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Type: application/json Jun 23 22:35:53.867134 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Host: 10.222.0.43 Jun 23 22:35:53.867134 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Openstack-System-Scope: None Jun 23 22:35:53.867134 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: User-Agent: python-urllib3/1.26.9 Jun 23 22:35:53.867134 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Auth-Token: gAAAAABitOrHWmoi-ePLNMft5tgpAY06i6b2IQhH9W_88lf7AW6Ww9nz819dhPhEG8cbeSlI0JZkGNe41IKDu38NvL3Wh0DSnvZh2jbONmkwoh6A7RE6EmU61iwHpBCA2xcJOQ1jFR9p_Cy0J_baDK0-nOYae57tIQsu2aI8KzT6DIpizuoQdCc Jun 23 22:35:53.867134 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Id: None Jun 23 22:35:53.867134 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Name: None Jun 23 22:35:53.867134 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Identity-Status: Confirmed Jun 23 22:35:53.867134 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Is-Admin-Project: True Jun 23 22:35:53.867134 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Id: default Jun 23 22:35:53.867134 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Name: Default Jun 23 22:35:53.867134 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Id: 2d484d9303ed401fbd838f2c6bb9c04d Jun 23 22:35:53.867134 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Name: tempest-VolumesNegativeTest-762996238 Jun 23 22:35:53.867134 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Role: reader,member Jun 23 22:35:53.867134 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Roles: reader,member Jun 23 22:35:53.868563 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2d484d9303ed401fbd838f2c6bb9c04d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2d484d9303ed401fbd838f2c6bb9c04d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2d484d9303ed401fbd838f2c6bb9c04d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2d484d9303ed401fbd838f2c6bb9c04d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:35:53.868563 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant: tempest-VolumesNegativeTest-762996238 Jun 23 22:35:53.868563 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Id: 2d484d9303ed401fbd838f2c6bb9c04d Jun 23 22:35:53.868563 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Name: tempest-VolumesNegativeTest-762996238 Jun 23 22:35:53.868563 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User: tempest-VolumesNegativeTest-762996238-project Jun 23 22:35:53.868563 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Id: default Jun 23 22:35:53.868563 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Name: Default Jun 23 22:35:53.868563 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Id: ea3c44869fe74d628b8dd5ecd0c22485 Jun 23 22:35:53.868563 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Name: tempest-VolumesNegativeTest-762996238-project Jun 23 22:35:53.868563 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: method: Jun 23 22:35:53.868563 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: exception: Volume f7d34cbf-de63-41bc-a9d4-ab04551b422e could not be found. Jun 23 22:35:53.868563 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: action_args: {'id': 'f7d34cbf-de63-41bc-a9d4-ab04551b422e'} Jun 23 22:35:53.868563 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:35:53.869321 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:35:53.869321 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 22:35:53.869321 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 22:35:53.869321 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 22:35:53.869321 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 22:35:53.869321 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 22:35:53.869321 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 22:35:53.869321 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 22:35:53.869321 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 22:35:53.869321 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 22:35:53.869321 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 22:35:53.869321 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 22:35:53.869321 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 22:35:53.869321 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 22:35:53.869321 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 22:35:53.869321 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f7d34cbf-de63-41bc-a9d4-ab04551b422e could not be found. (HTTP 404) (Request-ID: req-927e5106-6f54-4ca7-9987-13a7ee8793cd) Jun 23 22:35:53.869321 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:53.869321 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:35:53.869321 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:53.870430 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:35:53.870430 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 23 22:35:53.870430 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 23 22:35:53.870430 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 22:35:53.870430 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 22:35:53.870430 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 22:35:53.870430 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 22:35:53.870430 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 22:35:53.870430 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 22:35:53.870430 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 22:35:53.870430 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 22:35:53.870430 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 22:35:53.870430 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 22:35:53.870430 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 22:35:53.870430 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 22:35:53.870430 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 22:35:53.870430 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 22:35:53.870430 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 22:35:53.870430 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 22:35:53.871953 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 22:35:53.871953 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 22:35:53.871953 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 22:35:53.871953 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 22:35:53.871953 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f7d34cbf-de63-41bc-a9d4-ab04551b422e could not be found. Jun 23 22:35:53.871953 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:53.871953 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:35:53.871953 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:53.871953 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:35:53.871953 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:35:53.871953 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:35:53.871953 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:35:53.871953 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:35:53.871953 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 22:35:53.871953 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 22:35:53.871953 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:35:53.871953 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:35:53.871953 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 23 22:35:53.871953 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:35:53.873601 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f7d34cbf-de63-41bc-a9d4-ab04551b422e could not be found. Jun 23 22:35:53.873601 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:53.873601 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:35:53.873601 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:53.873601 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:35:53.873601 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:35:53.873601 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:35:53.873601 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:35:53.873601 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:35:53.873601 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f7d34cbf-de63-41bc-a9d4-ab04551b422e could not be found. Jun 23 22:35:53.873601 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:53.873601 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-9d4887cb-1a5a-46e0-9033-dc205062ca3f tempest-VolumesNegativeTest-762996238 tempest-VolumesNegativeTest-762996238-project] Returning 404 to user: Volume f7d34cbf-de63-41bc-a9d4-ab04551b422e could not be found. {{(pid=124357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:35:53.873601 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-9d4887cb-1a5a-46e0-9033-dc205062ca3f tempest-VolumesNegativeTest-762996238 tempest-VolumesNegativeTest-762996238-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/f7d34cbf-de63-41bc-a9d4-ab04551b422e" status: 404 len: 109 microversion: 2.1 time: 0.221279 Jun 23 22:35:53.873601 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 7/7] 10.222.0.43 () {58 vars in 1247 bytes} [Thu Jun 23 22:35:53 2022] DELETE /compute/v2.1/os-volumes/f7d34cbf-de63-41bc-a9d4-ab04551b422e => generated 109 bytes in 222 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:35:53.884713 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-3e4b358a-7a70-4e49-9c6d-65d986029a12 tempest-VolumesTestJSON-1637738392 tempest-VolumesTestJSON-1637738392-project] Calling method '.version_select at 0x7fb71b554ee0>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:35:54.043493 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-3e4b358a-7a70-4e49-9c6d-65d986029a12 tempest-VolumesTestJSON-1637738392 tempest-VolumesTestJSON-1637738392-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/968f7514-3432-4483-99a6-10486cdace71" status: 200 len: 350 microversion: 2.1 time: 0.171584 Jun 23 22:35:54.044605 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 8/8] 10.222.0.43 () {58 vars in 1244 bytes} [Thu Jun 23 22:35:53 2022] GET /compute/v2.1/os-volumes/968f7514-3432-4483-99a6-10486cdace71 => generated 350 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:35:54.056584 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-7e6c21e0-99d1-4e43-8268-b60d50f2314c tempest-VolumesNegativeTest-762996238 tempest-VolumesNegativeTest-762996238-project] Calling method '.version_select at 0x7fb71b5a3670>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:35:54.541963 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.wsgi [None req-7e6c21e0-99d1-4e43-8268-b60d50f2314c tempest-VolumesNegativeTest-762996238 tempest-VolumesNegativeTest-762996238-project] HTTP exception thrown: Volume 161dd0c2-c50e-46a1-a229-b177b14e0d37 could not be found. Jun 23 22:35:54.543947 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-7e6c21e0-99d1-4e43-8268-b60d50f2314c tempest-VolumesNegativeTest-762996238 tempest-VolumesNegativeTest-762996238-project] Request method failure captured: Jun 23 22:35:54.543947 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: request: GET /compute/v2.1/os-volumes/161dd0c2-c50e-46a1-a229-b177b14e0d37 HTTP/1.1 Jun 23 22:35:54.543947 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept: application/json Jun 23 22:35:54.543947 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept-Encoding: identity Jun 23 22:35:54.543947 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Connection: close Jun 23 22:35:54.543947 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Length: 0 Jun 23 22:35:54.543947 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Type: application/json Jun 23 22:35:54.543947 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Host: 10.222.0.43 Jun 23 22:35:54.543947 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Openstack-System-Scope: None Jun 23 22:35:54.543947 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: User-Agent: python-urllib3/1.26.9 Jun 23 22:35:54.543947 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Auth-Token: gAAAAABitOrHWmoi-ePLNMft5tgpAY06i6b2IQhH9W_88lf7AW6Ww9nz819dhPhEG8cbeSlI0JZkGNe41IKDu38NvL3Wh0DSnvZh2jbONmkwoh6A7RE6EmU61iwHpBCA2xcJOQ1jFR9p_Cy0J_baDK0-nOYae57tIQsu2aI8KzT6DIpizuoQdCc Jun 23 22:35:54.543947 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Id: None Jun 23 22:35:54.543947 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Name: None Jun 23 22:35:54.543947 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Identity-Status: Confirmed Jun 23 22:35:54.543947 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Is-Admin-Project: True Jun 23 22:35:54.543947 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Id: default Jun 23 22:35:54.543947 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Name: Default Jun 23 22:35:54.543947 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Id: 2d484d9303ed401fbd838f2c6bb9c04d Jun 23 22:35:54.543947 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Name: tempest-VolumesNegativeTest-762996238 Jun 23 22:35:54.543947 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Role: reader,member Jun 23 22:35:54.543947 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Roles: reader,member Jun 23 22:35:54.546092 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2d484d9303ed401fbd838f2c6bb9c04d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2d484d9303ed401fbd838f2c6bb9c04d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2d484d9303ed401fbd838f2c6bb9c04d", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2d484d9303ed401fbd838f2c6bb9c04d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:35:54.546092 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant: tempest-VolumesNegativeTest-762996238 Jun 23 22:35:54.546092 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Id: 2d484d9303ed401fbd838f2c6bb9c04d Jun 23 22:35:54.546092 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Name: tempest-VolumesNegativeTest-762996238 Jun 23 22:35:54.546092 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User: tempest-VolumesNegativeTest-762996238-project Jun 23 22:35:54.546092 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Id: default Jun 23 22:35:54.546092 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Name: Default Jun 23 22:35:54.546092 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Id: ea3c44869fe74d628b8dd5ecd0c22485 Jun 23 22:35:54.546092 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Name: tempest-VolumesNegativeTest-762996238-project Jun 23 22:35:54.546092 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: method: Jun 23 22:35:54.546092 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: exception: Volume 161dd0c2-c50e-46a1-a229-b177b14e0d37 could not be found. Jun 23 22:35:54.546092 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: action_args: {'id': '161dd0c2-c50e-46a1-a229-b177b14e0d37'} Jun 23 22:35:54.546092 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:35:54.547000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:35:54.547000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 22:35:54.547000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 22:35:54.547000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 22:35:54.547000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 22:35:54.547000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 22:35:54.547000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 22:35:54.547000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 22:35:54.547000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 22:35:54.547000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 22:35:54.547000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 22:35:54.547000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 22:35:54.547000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 22:35:54.547000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 22:35:54.547000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 22:35:54.547000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 161dd0c2-c50e-46a1-a229-b177b14e0d37 could not be found. (HTTP 404) (Request-ID: req-b0eaa42b-a346-4434-b322-5489ba3847ac) Jun 23 22:35:54.547000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:54.547000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:35:54.547000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:54.562890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:35:54.562890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 22:35:54.562890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 22:35:54.562890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 22:35:54.562890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 22:35:54.562890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 22:35:54.562890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 22:35:54.562890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 22:35:54.562890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 22:35:54.562890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 22:35:54.562890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 22:35:54.562890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 22:35:54.562890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 22:35:54.562890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 22:35:54.562890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 22:35:54.562890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 22:35:54.562890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 22:35:54.562890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 22:35:54.562890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 22:35:54.566367 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 22:35:54.566367 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 22:35:54.566367 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 22:35:54.566367 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 22:35:54.566367 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 161dd0c2-c50e-46a1-a229-b177b14e0d37 could not be found. Jun 23 22:35:54.566367 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:54.566367 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:35:54.566367 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:54.566367 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:35:54.566367 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:35:54.566367 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:35:54.566367 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:35:54.566367 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:35:54.566367 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 22:35:54.566367 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 22:35:54.566367 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:35:54.566367 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:35:54.566367 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 22:35:54.566367 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:35:54.570226 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 161dd0c2-c50e-46a1-a229-b177b14e0d37 could not be found. Jun 23 22:35:54.570226 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:54.570226 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:35:54.570226 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:54.570226 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:35:54.570226 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:35:54.570226 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:35:54.570226 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:35:54.570226 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:35:54.570226 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 161dd0c2-c50e-46a1-a229-b177b14e0d37 could not be found. Jun 23 22:35:54.570226 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:35:54.570226 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-7e6c21e0-99d1-4e43-8268-b60d50f2314c tempest-VolumesNegativeTest-762996238 tempest-VolumesNegativeTest-762996238-project] Returning 404 to user: Volume 161dd0c2-c50e-46a1-a229-b177b14e0d37 could not be found. {{(pid=124357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:35:54.570226 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-7e6c21e0-99d1-4e43-8268-b60d50f2314c tempest-VolumesNegativeTest-762996238 tempest-VolumesNegativeTest-762996238-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/161dd0c2-c50e-46a1-a229-b177b14e0d37" status: 404 len: 109 microversion: 2.1 time: 0.499234 Jun 23 22:35:54.570226 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 9/9] 10.222.0.43 () {58 vars in 1244 bytes} [Thu Jun 23 22:35:54 2022] GET /compute/v2.1/os-volumes/161dd0c2-c50e-46a1-a229-b177b14e0d37 => generated 109 bytes in 500 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:35:54.740770 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d0d821fd-ae21-4270-863b-88ea0c394563 tempest-VolumesGetTestJSON-1542543254 tempest-VolumesGetTestJSON-1542543254-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.815871 Jun 23 22:35:54.741519 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 1/10] 10.222.0.43 () {60 vars in 1155 bytes} [Thu Jun 23 22:35:50 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3818 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 23 22:35:54.754738 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-13f8b440-f180-4d1e-8afe-b897d204bd63 tempest-VolumesGetTestJSON-1542543254 tempest-VolumesGetTestJSON-1542543254-project] Calling method '.version_select at 0x7fb71b5a3670>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:35:54.947941 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-13f8b440-f180-4d1e-8afe-b897d204bd63 tempest-VolumesGetTestJSON-1542543254 tempest-VolumesGetTestJSON-1542543254-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/a5c89cad-3a5b-49d5-a986-60ff150c4998" status: 200 len: 353 microversion: 2.1 time: 0.197581 Jun 23 22:35:54.948752 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 10/11] 10.222.0.43 () {58 vars in 1244 bytes} [Thu Jun 23 22:35:54 2022] GET /compute/v2.1/os-volumes/a5c89cad-3a5b-49d5-a986-60ff150c4998 => generated 353 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:35:55.970635 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-97b095f2-930e-48dd-9f98-5fd1336d9dc6 tempest-VolumesGetTestJSON-1542543254 tempest-VolumesGetTestJSON-1542543254-project] Calling method '.version_select at 0x7fb71b5c1550>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:35:55.971564 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-57a2c5a9-d741-4ce0-b05d-3b8aa9b5fee0 tempest-VolumesTestJSON-1637738392 tempest-VolumesTestJSON-1637738392-project] Calling method '.version_select at 0x7fb71b554940>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:35:56.122186 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-57a2c5a9-d741-4ce0-b05d-3b8aa9b5fee0 tempest-VolumesTestJSON-1637738392 tempest-VolumesTestJSON-1637738392-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/c46ec8ee-4431-4a44-bf74-f9baf58e59f2" status: 200 len: 351 microversion: 2.1 time: 0.160582 Jun 23 22:35:56.128207 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 11/12] 10.222.0.43 () {58 vars in 1244 bytes} [Thu Jun 23 22:35:55 2022] GET /compute/v2.1/os-volumes/c46ec8ee-4431-4a44-bf74-f9baf58e59f2 => generated 351 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:35:56.146522 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-97b095f2-930e-48dd-9f98-5fd1336d9dc6 tempest-VolumesGetTestJSON-1542543254 tempest-VolumesGetTestJSON-1542543254-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/a5c89cad-3a5b-49d5-a986-60ff150c4998" status: 200 len: 354 microversion: 2.1 time: 0.188512 Jun 23 22:35:56.153058 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 2/13] 10.222.0.43 () {58 vars in 1244 bytes} [Thu Jun 23 22:35:55 2022] GET /compute/v2.1/os-volumes/a5c89cad-3a5b-49d5-a986-60ff150c4998 => generated 354 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:35:56.160948 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-d94c89bf-86e2-4907-93cd-a8b2cbd6d391 tempest-VolumesGetTestJSON-1542543254 tempest-VolumesGetTestJSON-1542543254-project] Calling method '.version_select at 0x7fb71b4e70d0>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:35:56.278359 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-d94c89bf-86e2-4907-93cd-a8b2cbd6d391 tempest-VolumesGetTestJSON-1542543254 tempest-VolumesGetTestJSON-1542543254-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/a5c89cad-3a5b-49d5-a986-60ff150c4998" status: 200 len: 354 microversion: 2.1 time: 0.123209 Jun 23 22:35:56.290801 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 12/14] 10.222.0.43 () {58 vars in 1244 bytes} [Thu Jun 23 22:35:56 2022] GET /compute/v2.1/os-volumes/a5c89cad-3a5b-49d5-a986-60ff150c4998 => generated 354 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:35:56.297771 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-66c020e5-94b7-4970-a0a3-5a92345911d4 tempest-VolumesGetTestJSON-1542543254 tempest-VolumesGetTestJSON-1542543254-project] Calling method '.version_select at 0x7fb71b5c18b0>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:35:56.683009 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-66c020e5-94b7-4970-a0a3-5a92345911d4 tempest-VolumesGetTestJSON-1542543254 tempest-VolumesGetTestJSON-1542543254-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/a5c89cad-3a5b-49d5-a986-60ff150c4998" status: 202 len: 0 microversion: 2.1 time: 0.390189 Jun 23 22:35:56.683781 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 3/15] 10.222.0.43 () {58 vars in 1247 bytes} [Thu Jun 23 22:35:56 2022] DELETE /compute/v2.1/os-volumes/a5c89cad-3a5b-49d5-a986-60ff150c4998 => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:35:56.692305 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-35802084-9bab-486c-bcc5-446f32068b16 tempest-VolumesGetTestJSON-1542543254 tempest-VolumesGetTestJSON-1542543254-project] Calling method '.version_select at 0x7fb71b4e7790>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:35:56.820829 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-35802084-9bab-486c-bcc5-446f32068b16 tempest-VolumesGetTestJSON-1542543254 tempest-VolumesGetTestJSON-1542543254-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/a5c89cad-3a5b-49d5-a986-60ff150c4998" status: 200 len: 353 microversion: 2.1 time: 0.132528 Jun 23 22:35:56.826625 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 13/16] 10.222.0.43 () {58 vars in 1244 bytes} [Thu Jun 23 22:35:56 2022] GET /compute/v2.1/os-volumes/a5c89cad-3a5b-49d5-a986-60ff150c4998 => generated 353 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:35:57.834853 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-dcd8d3a2-352f-41a6-8f44-ca03cd58a213 tempest-VolumesGetTestJSON-1542543254 tempest-VolumesGetTestJSON-1542543254-project] Calling method '.version_select at 0x7fb71b5c1d30>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:35:57.889311 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-dcd8d3a2-352f-41a6-8f44-ca03cd58a213 tempest-VolumesGetTestJSON-1542543254 tempest-VolumesGetTestJSON-1542543254-project] HTTP exception thrown: Volume a5c89cad-3a5b-49d5-a986-60ff150c4998 could not be found. Jun 23 22:35:57.894693 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-dcd8d3a2-352f-41a6-8f44-ca03cd58a213 tempest-VolumesGetTestJSON-1542543254 tempest-VolumesGetTestJSON-1542543254-project] Request method failure captured: Jun 23 22:35:57.894693 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: request: GET /compute/v2.1/os-volumes/a5c89cad-3a5b-49d5-a986-60ff150c4998 HTTP/1.1 Jun 23 22:35:57.894693 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept: application/json Jun 23 22:35:57.894693 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Jun 23 22:35:57.894693 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Connection: close Jun 23 22:35:57.894693 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Length: 0 Jun 23 22:35:57.894693 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Type: application/json Jun 23 22:35:57.894693 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Host: 10.222.0.43 Jun 23 22:35:57.894693 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Jun 23 22:35:57.894693 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.9 Jun 23 22:35:57.894693 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABitOrG1RW9mYkdzMGnlvjNNzU0O2UdXlfbn_US3E72ijGVhzgHHNswspgB7QUTjHh7yTeay4CxRLEe-k8GjncnoArR_mljUj1FPE2Z2_zenZoLmlBi5HdaHeheVoy9wG46wTxJ3s48vmIJRHirzcaoJWOagSFIr6DogmJ0_Q8WD_zSPH0 Jun 23 22:35:57.894693 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Jun 23 22:35:57.894693 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Jun 23 22:35:57.894693 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Jun 23 22:35:57.894693 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Jun 23 22:35:57.894693 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Jun 23 22:35:57.894693 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Jun 23 22:35:57.894693 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Id: e3870456e11b4171ab9ed057ebdf2088 Jun 23 22:35:57.894693 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-VolumesGetTestJSON-1542543254 Jun 23 22:35:57.894693 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Role: reader,member Jun 23 22:35:57.894693 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Roles: reader,member Jun 23 22:35:57.895841 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e3870456e11b4171ab9ed057ebdf2088"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e3870456e11b4171ab9ed057ebdf2088"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e3870456e11b4171ab9ed057ebdf2088", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e3870456e11b4171ab9ed057ebdf2088"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:35:57.895841 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-VolumesGetTestJSON-1542543254 Jun 23 22:35:57.895841 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Id: e3870456e11b4171ab9ed057ebdf2088 Jun 23 22:35:57.895841 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-VolumesGetTestJSON-1542543254 Jun 23 22:35:57.895841 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User: tempest-VolumesGetTestJSON-1542543254-project Jun 23 22:35:57.895841 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Jun 23 22:35:57.895841 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Jun 23 22:35:57.895841 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Id: 4809dd1bd3ea4bb4a80de8a09f7eec6e Jun 23 22:35:57.895841 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-VolumesGetTestJSON-1542543254-project Jun 23 22:35:57.895841 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: method: Jun 23 22:35:57.895841 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: exception: Volume a5c89cad-3a5b-49d5-a986-60ff150c4998 could not be found. Jun 23 22:35:57.895841 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: action_args: {'id': 'a5c89cad-3a5b-49d5-a986-60ff150c4998'} Jun 23 22:35:57.895841 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:35:57.896454 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:35:57.896454 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 22:35:57.896454 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 22:35:57.896454 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 22:35:57.896454 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 22:35:57.896454 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 22:35:57.896454 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 22:35:57.896454 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 22:35:57.896454 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 22:35:57.896454 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 22:35:57.896454 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 22:35:57.896454 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 22:35:57.896454 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 22:35:57.896454 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 22:35:57.896454 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 22:35:57.896454 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a5c89cad-3a5b-49d5-a986-60ff150c4998 could not be found. (HTTP 404) (Request-ID: req-923cbbf9-5769-441f-8cd9-2ba0cbe09810) Jun 23 22:35:57.896454 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:35:57.896454 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:35:57.896454 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:35:57.897430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:35:57.897430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 22:35:57.897430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 22:35:57.897430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 22:35:57.897430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 22:35:57.897430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 22:35:57.897430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 22:35:57.897430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 22:35:57.897430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 22:35:57.897430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 22:35:57.897430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 22:35:57.897430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 22:35:57.897430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 22:35:57.897430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 22:35:57.897430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 22:35:57.897430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 22:35:57.897430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 22:35:57.897430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 22:35:57.897430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 22:35:57.898276 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 22:35:57.898276 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 22:35:57.898276 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 22:35:57.898276 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 22:35:57.898276 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a5c89cad-3a5b-49d5-a986-60ff150c4998 could not be found. Jun 23 22:35:57.898276 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:35:57.898276 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:35:57.898276 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:35:57.898276 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:35:57.898276 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:35:57.898276 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:35:57.898276 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:35:57.898276 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:35:57.898276 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 22:35:57.898276 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 22:35:57.898276 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:35:57.898276 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:35:57.898276 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 22:35:57.898276 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:35:57.899171 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a5c89cad-3a5b-49d5-a986-60ff150c4998 could not be found. Jun 23 22:35:57.899171 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:35:57.899171 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:35:57.899171 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:35:57.899171 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:35:57.899171 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:35:57.899171 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:35:57.899171 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:35:57.899171 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:35:57.899171 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a5c89cad-3a5b-49d5-a986-60ff150c4998 could not be found. Jun 23 22:35:57.899171 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:35:57.899171 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-dcd8d3a2-352f-41a6-8f44-ca03cd58a213 tempest-VolumesGetTestJSON-1542543254 tempest-VolumesGetTestJSON-1542543254-project] Returning 404 to user: Volume a5c89cad-3a5b-49d5-a986-60ff150c4998 could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:35:57.899171 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-dcd8d3a2-352f-41a6-8f44-ca03cd58a213 tempest-VolumesGetTestJSON-1542543254 tempest-VolumesGetTestJSON-1542543254-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/a5c89cad-3a5b-49d5-a986-60ff150c4998" status: 404 len: 109 microversion: 2.1 time: 0.065852 Jun 23 22:35:57.901000 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 4/17] 10.222.0.43 () {58 vars in 1244 bytes} [Thu Jun 23 22:35:57 2022] GET /compute/v2.1/os-volumes/a5c89cad-3a5b-49d5-a986-60ff150c4998 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:35:58.210005 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-197a6788-c625-4c2e-aee6-49e617d5852f tempest-VolumesTestJSON-1637738392 tempest-VolumesTestJSON-1637738392-project] Calling method '.version_select at 0x7fb71b55be50>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:35:58.319895 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-197a6788-c625-4c2e-aee6-49e617d5852f tempest-VolumesTestJSON-1637738392 tempest-VolumesTestJSON-1637738392-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/f06217a4-8bf0-4415-8e36-b1049f622410" status: 200 len: 350 microversion: 2.1 time: 0.113747 Jun 23 22:35:58.322797 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 5/18] 10.222.0.43 () {58 vars in 1244 bytes} [Thu Jun 23 22:35:58 2022] GET /compute/v2.1/os-volumes/f06217a4-8bf0-4415-8e36-b1049f622410 => generated 350 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:35:58.336183 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-2f43874c-a551-40dc-a631-7b8388d2a930 tempest-VolumesTestJSON-1637738392 tempest-VolumesTestJSON-1637738392-project] Calling method '.version_select at 0x7fb71b5414c0>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:35:58.533257 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-4b328d38-29a3-4965-a509-36c231e2ce3d tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Action: 'create', calling method: .version_select at 0x7fb71b5549d0>, body: {"keypair": {"name": "tempest-keypair-1435201750", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfNL44P7eSJnZ0CR78D00FhKUI2GnraxAIqByffLf2nXmPFXX6FQpQSZ4lEOlh98XavVcwPn1LoTp0ZZ3Q8lc5hQwQLmPv6oW3GKoQ2njDXuvIZvk/9zgfxNSW97lEsQQ=="}} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:35:58.579989 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-2f43874c-a551-40dc-a631-7b8388d2a930 tempest-VolumesTestJSON-1637738392 tempest-VolumesTestJSON-1637738392-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.248558 Jun 23 22:35:58.580551 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 6/19] 10.222.0.43 () {58 vars in 1133 bytes} [Thu Jun 23 22:35:58 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:35:58.595971 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-ab454f90-2fd4-4c2c-97dc-9075fdb89ed9 tempest-VolumesTestJSON-1637738392 tempest-VolumesTestJSON-1637738392-project] Calling method '.version_select at 0x7fb71b55b940>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:35:58.700166 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-4b328d38-29a3-4965-a509-36c231e2ce3d tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Getting quotas for project c751cc6b8ac64f3fb7adc9bc71575bd2. Resources: {'key_pairs'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:35:58.724767 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-4b328d38-29a3-4965-a509-36c231e2ce3d tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Getting quotas for user f53284773f7a430db3d0e16d3c2cd262 and project c751cc6b8ac64f3fb7adc9bc71575bd2. Resources: {'key_pairs'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:35:58.855749 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-4b328d38-29a3-4965-a509-36c231e2ce3d tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.834575 Jun 23 22:35:58.856732 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 14/20] 10.222.0.43 () {60 vars in 1158 bytes} [Thu Jun 23 22:35:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:35:58.874696 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-ab454f90-2fd4-4c2c-97dc-9075fdb89ed9 tempest-VolumesTestJSON-1637738392 tempest-VolumesTestJSON-1637738392-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.284245 Jun 23 22:35:58.893555 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 7/21] 10.222.0.43 () {58 vars in 1148 bytes} [Thu Jun 23 22:35:58 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:35:58.898427 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-5a4d6564-9b83-4d65-9db6-c1fff4dc3680 tempest-VolumesTestJSON-1637738392 tempest-VolumesTestJSON-1637738392-project] Calling method '.version_select at 0x7fb71b4c9310>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:35:59.171644 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-5a4d6564-9b83-4d65-9db6-c1fff4dc3680 tempest-VolumesTestJSON-1637738392 tempest-VolumesTestJSON-1637738392-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.276998 Jun 23 22:35:59.172873 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 15/22] 10.222.0.43 () {58 vars in 1133 bytes} [Thu Jun 23 22:35:58 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:35:59.183703 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-9393d4c0-0a32-4c5e-bd89-2a1bc581cd77 tempest-VolumesTestJSON-1637738392 tempest-VolumesTestJSON-1637738392-project] Calling method '.version_select at 0x7fb71b541b80>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:35:59.348088 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-9393d4c0-0a32-4c5e-bd89-2a1bc581cd77 tempest-VolumesTestJSON-1637738392 tempest-VolumesTestJSON-1637738392-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.167945 Jun 23 22:35:59.348660 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 8/23] 10.222.0.43 () {58 vars in 1166 bytes} [Thu Jun 23 22:35:59 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:35:59.365475 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-2897b0f2-57cf-49b8-8160-3302e1aebbc7 tempest-VolumesTestJSON-1637738392 tempest-VolumesTestJSON-1637738392-project] Calling method '.version_select at 0x7fb71b4c9dc0>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:35:59.536995 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-2897b0f2-57cf-49b8-8160-3302e1aebbc7 tempest-VolumesTestJSON-1637738392 tempest-VolumesTestJSON-1637738392-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.177373 Jun 23 22:35:59.546901 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 16/24] 10.222.0.43 () {58 vars in 1169 bytes} [Thu Jun 23 22:35:59 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:35:59.551899 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-dc6ef839-4269-4d0e-8afc-29123388739d tempest-VolumesTestJSON-1637738392 tempest-VolumesTestJSON-1637738392-project] Calling method '.version_select at 0x7fb71b55c040>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:35:59.753027 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-dc6ef839-4269-4d0e-8afc-29123388739d tempest-VolumesTestJSON-1637738392 tempest-VolumesTestJSON-1637738392-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.204848 Jun 23 22:35:59.754106 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 9/25] 10.222.0.43 () {58 vars in 1154 bytes} [Thu Jun 23 22:35:59 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:35:59.765242 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-16e73759-d0ab-4a47-91fb-c19f6a4c0379 tempest-VolumesTestJSON-1637738392 tempest-VolumesTestJSON-1637738392-project] Calling method '.version_select at 0x7fb71ac79160>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:35:59.944593 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-16e73759-d0ab-4a47-91fb-c19f6a4c0379 tempest-VolumesTestJSON-1637738392 tempest-VolumesTestJSON-1637738392-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.183194 Jun 23 22:35:59.948798 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 17/26] 10.222.0.43 () {58 vars in 1187 bytes} [Thu Jun 23 22:35:59 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:35:59.963590 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-63b52c4a-4c84-46c9-a83d-cb15dea7cd53 tempest-VolumesTestJSON-1637738392 tempest-VolumesTestJSON-1637738392-project] Calling method '.version_select at 0x7fb71b541430>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:00.169261 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-63b52c4a-4c84-46c9-a83d-cb15dea7cd53 tempest-VolumesTestJSON-1637738392 tempest-VolumesTestJSON-1637738392-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.210090 Jun 23 22:36:00.170974 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 10/27] 10.222.0.43 () {58 vars in 1154 bytes} [Thu Jun 23 22:35:59 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:07.805767 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-82c859d8-4803-4332-831f-d66ddebf0884 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Action: 'create', calling method: .version_select at 0x7fb71ac79dc0>, body: {"keypair": {"name": "tempest-keypair-1129086786", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO99lkdoUfoEb0nH3wkftFaLNxlq9aHwGBVzJ/OuzAKoViCqks7TqW7EBAcU+hc0vJFMFgzfJpnD9tHg267WvRSbBegnpvgbbufgpUflQwky4pSjk2BpbKiID/mdu7B5rg=="}} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:36:07.847795 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-82c859d8-4803-4332-831f-d66ddebf0884 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Getting quotas for project 2735e40fe2564a6d8a5cdc7c32b0b869. Resources: {'key_pairs'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:36:07.858401 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-82c859d8-4803-4332-831f-d66ddebf0884 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Getting quotas for user 03486c7630314392b85271455d12aba2 and project 2735e40fe2564a6d8a5cdc7c32b0b869. Resources: {'key_pairs'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:36:07.927356 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-82c859d8-4803-4332-831f-d66ddebf0884 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.261811 Jun 23 22:36:07.935688 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 18/28] 10.222.0.43 () {60 vars in 1158 bytes} [Thu Jun 23 22:36:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:36:09.514072 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e5c1c1a1-bce8-4192-bc73-d35b7dde80df tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-265527752", "imageRef": "ac7d441e-2ac8-49ad-9dc5-3c55bd4b4f8b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "69c6d8a0-202c-42d8-bb93-5c3836a8475f"}], "security_groups": [{"name": "tempest-securitygroup--600923694"}], "key_name": "tempest-keypair-1435201750", "user_data": "}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:36:10.995091 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.network.neutron [None req-e5c1c1a1-bce8-4192-bc73-d35b7dde80df tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] validate_networks() for [('69c6d8a0-202c-42d8-bb93-5c3836a8475f', None, None, None, None, None)] {{(pid=124358) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:36:11.415473 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-c1bbcbe6-a3a0-44e4-a433-65478c68e927 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1608628726", "imageRef": "ac7d441e-2ac8-49ad-9dc5-3c55bd4b4f8b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:36:11.559754 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.network.neutron [None req-c1bbcbe6-a3a0-44e4-a433-65478c68e927 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] validate_networks() for [('37491e26-b7d3-4482-a2c4-21c5caef5449', None, None, None, None, None)] {{(pid=124357) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:36:12.663574 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-e5c1c1a1-bce8-4192-bc73-d35b7dde80df tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Flavor limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:36:12.664081 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-e5c1c1a1-bce8-4192-bc73-d35b7dde80df tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Image limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:36:12.664466 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-e5c1c1a1-bce8-4192-bc73-d35b7dde80df tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Flavor pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:36:12.664969 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-e5c1c1a1-bce8-4192-bc73-d35b7dde80df tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Image pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:36:12.665300 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-e5c1c1a1-bce8-4192-bc73-d35b7dde80df tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:36:12.694110 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e5c1c1a1-bce8-4192-bc73-d35b7dde80df tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:12.694752 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e5c1c1a1-bce8-4192-bc73-d35b7dde80df tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:12.696845 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e5c1c1a1-bce8-4192-bc73-d35b7dde80df tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:12.700307 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e5c1c1a1-bce8-4192-bc73-d35b7dde80df tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:12.783866 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-e5c1c1a1-bce8-4192-bc73-d35b7dde80df tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Getting quotas for project c751cc6b8ac64f3fb7adc9bc71575bd2. Resources: {'instances', 'cores', 'ram'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:36:12.800910 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-e5c1c1a1-bce8-4192-bc73-d35b7dde80df tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Getting quotas for user f53284773f7a430db3d0e16d3c2cd262 and project c751cc6b8ac64f3fb7adc9bc71575bd2. Resources: {'instances', 'cores', 'ram'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:36:12.823119 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e5c1c1a1-bce8-4192-bc73-d35b7dde80df tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Going to run 1 instances... {{(pid=124358) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:36:12.832565 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e5c1c1a1-bce8-4192-bc73-d35b7dde80df tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ac7d441e-2ac8-49ad-9dc5-3c55bd4b4f8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:36:13.054326 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e5c1c1a1-bce8-4192-bc73-d35b7dde80df tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.550129 Jun 23 22:36:13.055736 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 11/29] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Jun 23 22:36:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 3552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 22:36:13.922799 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-c1bbcbe6-a3a0-44e4-a433-65478c68e927 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Flavor limits 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:36:13.924358 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-c1bbcbe6-a3a0-44e4-a433-65478c68e927 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Image limits 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:36:13.924892 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-c1bbcbe6-a3a0-44e4-a433-65478c68e927 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Flavor pref 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:36:13.925491 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-c1bbcbe6-a3a0-44e4-a433-65478c68e927 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Image pref 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:36:13.925905 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-c1bbcbe6-a3a0-44e4-a433-65478c68e927 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:36:13.962444 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c1bbcbe6-a3a0-44e4-a433-65478c68e927 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:13.962899 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c1bbcbe6-a3a0-44e4-a433-65478c68e927 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:13.963713 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c1bbcbe6-a3a0-44e4-a433-65478c68e927 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:13.970472 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c1bbcbe6-a3a0-44e4-a433-65478c68e927 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:14.011246 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e9d6062f-46e3-4b5a-b923-5c6e66bcc31a tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-390066403", "imageRef": "ac7d441e-2ac8-49ad-9dc5-3c55bd4b4f8b", "flavorRef": "452", "networks": [{"uuid": "bcb228fc-05ce-4620-ab8e-125664fd2aaa"}]}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:36:14.046707 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-c1bbcbe6-a3a0-44e4-a433-65478c68e927 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Getting quotas for project 192d1c8d15ce462dbf10fc3b519ab253. Resources: {'instances', 'cores', 'ram'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:36:14.058146 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-c1bbcbe6-a3a0-44e4-a433-65478c68e927 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Getting quotas for user dc246e144afc46698000f7f53ef6489e and project 192d1c8d15ce462dbf10fc3b519ab253. Resources: {'instances', 'cores', 'ram'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:36:14.103412 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-c1bbcbe6-a3a0-44e4-a433-65478c68e927 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Going to run 1 instances... {{(pid=124357) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:36:14.106740 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-c1bbcbe6-a3a0-44e4-a433-65478c68e927 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ac7d441e-2ac8-49ad-9dc5-3c55bd4b4f8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:36:14.196788 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.network.neutron [None req-e9d6062f-46e3-4b5a-b923-5c6e66bcc31a tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] validate_networks() for [('bcb228fc-05ce-4620-ab8e-125664fd2aaa', None, None, None, None, None)] {{(pid=124358) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:36:14.338480 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-c1bbcbe6-a3a0-44e4-a433-65478c68e927 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.309406 Jun 23 22:36:14.339280 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 19/30] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Jun 23 22:36:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 3311 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 23 22:36:14.350641 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-1fa09588-195a-46c3-9422-93fb86726513 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:14.352300 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-1fa09588-195a-46c3-9422-93fb86726513 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:14.732420 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-1fa09588-195a-46c3-9422-93fb86726513 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:14.761190 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-1fa09588-195a-46c3-9422-93fb86726513 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1237 microversion: 2.1 time: 0.420676 Jun 23 22:36:14.774550 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 20/31] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:14 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1237 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:14.798708 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-772a014c-ab87-4832-bb70-f4e520737010 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-898873242", "imageRef": "ac7d441e-2ac8-49ad-9dc5-3c55bd4b4f8b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e8170354-014e-4823-a204-b43deead6b56"}], "security_groups": [{"name": "tempest-securitygroup--1496808051"}], "key_name": "tempest-keypair-1129086786", "user_data": "}} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:36:15.236149 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.network.neutron [None req-772a014c-ab87-4832-bb70-f4e520737010 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] validate_networks() for [('e8170354-014e-4823-a204-b43deead6b56', None, None, None, None, None)] {{(pid=124357) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:36:16.488520 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-e9d6062f-46e3-4b5a-b923-5c6e66bcc31a tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Flavor limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:36:16.489116 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-e9d6062f-46e3-4b5a-b923-5c6e66bcc31a tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Image limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:36:16.489402 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-e9d6062f-46e3-4b5a-b923-5c6e66bcc31a tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Flavor pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:36:16.489810 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-e9d6062f-46e3-4b5a-b923-5c6e66bcc31a tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Image pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:36:16.490414 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-e9d6062f-46e3-4b5a-b923-5c6e66bcc31a tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:36:16.500088 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e9d6062f-46e3-4b5a-b923-5c6e66bcc31a tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:16.500803 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e9d6062f-46e3-4b5a-b923-5c6e66bcc31a tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:16.501933 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e9d6062f-46e3-4b5a-b923-5c6e66bcc31a tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:16.502523 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e9d6062f-46e3-4b5a-b923-5c6e66bcc31a tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:16.546792 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-e9d6062f-46e3-4b5a-b923-5c6e66bcc31a tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Getting quotas for project becdae52e5c64b1ea2bb05833505b0f8. Resources: {'instances', 'cores', 'ram'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:36:16.557459 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-e9d6062f-46e3-4b5a-b923-5c6e66bcc31a tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Getting quotas for user 53c519b28b174ef385dd7e76b85cf504 and project becdae52e5c64b1ea2bb05833505b0f8. Resources: {'instances', 'cores', 'ram'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:36:16.604451 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e9d6062f-46e3-4b5a-b923-5c6e66bcc31a tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Going to run 1 instances... {{(pid=124358) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:36:16.607609 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e9d6062f-46e3-4b5a-b923-5c6e66bcc31a tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ac7d441e-2ac8-49ad-9dc5-3c55bd4b4f8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:36:16.768696 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e9d6062f-46e3-4b5a-b923-5c6e66bcc31a tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.709684 Jun 23 22:36:16.774803 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 12/32] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Jun 23 22:36:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 22:36:16.798482 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-ed7944b6-35f2-48de-abf7-c8de10636a49 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:16.799183 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-ed7944b6-35f2-48de-abf7-c8de10636a49 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:16.848551 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ed7944b6-35f2-48de-abf7-c8de10636a49 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:16.849233 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ed7944b6-35f2-48de-abf7-c8de10636a49 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:16.850198 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ed7944b6-35f2-48de-abf7-c8de10636a49 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:16.850795 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ed7944b6-35f2-48de-abf7-c8de10636a49 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:17.352159 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-772a014c-ab87-4832-bb70-f4e520737010 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Flavor limits 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:36:17.354454 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-772a014c-ab87-4832-bb70-f4e520737010 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Image limits 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:36:17.355445 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-772a014c-ab87-4832-bb70-f4e520737010 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Flavor pref 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:36:17.356048 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-772a014c-ab87-4832-bb70-f4e520737010 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Image pref 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:36:17.357501 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-772a014c-ab87-4832-bb70-f4e520737010 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:36:17.393790 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-772a014c-ab87-4832-bb70-f4e520737010 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:17.401945 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-772a014c-ab87-4832-bb70-f4e520737010 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:17.405051 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ed7944b6-35f2-48de-abf7-c8de10636a49 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:17.407099 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-772a014c-ab87-4832-bb70-f4e520737010 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:17.408150 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-772a014c-ab87-4832-bb70-f4e520737010 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:17.465638 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-ed7944b6-35f2-48de-abf7-c8de10636a49 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4" status: 200 len: 1218 microversion: 2.1 time: 0.686117 Jun 23 22:36:17.467088 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 13/33] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:16 2022] GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 => generated 1218 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:17.484428 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-848a4e30-ec99-4240-8317-51860b7c0905 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:17.491292 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-848a4e30-ec99-4240-8317-51860b7c0905 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:17.518403 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-772a014c-ab87-4832-bb70-f4e520737010 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Getting quotas for project 2735e40fe2564a6d8a5cdc7c32b0b869. Resources: {'instances', 'cores', 'ram'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:36:17.531926 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-848a4e30-ec99-4240-8317-51860b7c0905 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:17.538771 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-772a014c-ab87-4832-bb70-f4e520737010 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Getting quotas for user 03486c7630314392b85271455d12aba2 and project 2735e40fe2564a6d8a5cdc7c32b0b869. Resources: {'instances', 'cores', 'ram'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:36:17.543097 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-848a4e30-ec99-4240-8317-51860b7c0905 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:17.545663 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-848a4e30-ec99-4240-8317-51860b7c0905 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:17.549947 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-848a4e30-ec99-4240-8317-51860b7c0905 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:17.616051 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-772a014c-ab87-4832-bb70-f4e520737010 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Going to run 1 instances... {{(pid=124357) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:36:17.641364 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-772a014c-ab87-4832-bb70-f4e520737010 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: cd22650e-6851-4f81-a8d4-e4c7ade26c73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ac7d441e-2ac8-49ad-9dc5-3c55bd4b4f8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:36:17.815897 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-772a014c-ab87-4832-bb70-f4e520737010 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.027293 Jun 23 22:36:17.816864 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 21/34] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Jun 23 22:36:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 3029 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 22:36:17.826467 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-058f0a0e-82ba-41c7-b0cd-6501a2cda42f tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:17.838281 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-058f0a0e-82ba-41c7-b0cd-6501a2cda42f tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:17.887982 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-848a4e30-ec99-4240-8317-51860b7c0905 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:17.897306 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-848a4e30-ec99-4240-8317-51860b7c0905 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1289 microversion: 2.1 time: 0.423085 Jun 23 22:36:17.920788 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 14/35] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:17 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1289 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:17.946352 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-6693ea87-38e3-4166-a68d-f3a5b710a7c0 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:17.949345 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-6693ea87-38e3-4166-a68d-f3a5b710a7c0 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: cd22650e-6851-4f81-a8d4-e4c7ade26c73] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:18.143510 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-058f0a0e-82ba-41c7-b0cd-6501a2cda42f tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c519b28b174ef385dd7e76b85cf504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becdae52e5c64b1ea2bb05833505b0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:18.151877 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-058f0a0e-82ba-41c7-b0cd-6501a2cda42f tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] 10.222.0.43 "GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de" status: 200 len: 1214 microversion: 2.1 time: 0.330089 Jun 23 22:36:18.169011 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 22/36] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:17 2022] GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de => generated 1214 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:18.179709 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-9dcba315-da5b-441f-9b28-ed73f7d32aec tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1178209730", "imageRef": "ac7d441e-2ac8-49ad-9dc5-3c55bd4b4f8b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:36:18.322834 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.network.neutron [None req-9dcba315-da5b-441f-9b28-ed73f7d32aec tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] validate_networks() for [('37491e26-b7d3-4482-a2c4-21c5caef5449', None, None, None, None, None)] {{(pid=124357) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:36:18.551991 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-6693ea87-38e3-4166-a68d-f3a5b710a7c0 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:18.581531 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-6693ea87-38e3-4166-a68d-f3a5b710a7c0 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73" status: 200 len: 1241 microversion: 2.1 time: 0.657262 Jun 23 22:36:18.586345 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 15/37] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:17 2022] GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73 => generated 1241 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:18.928609 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-1703450f-89fb-4f46-b19e-9ca02954bcd3 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:18.930734 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-1703450f-89fb-4f46-b19e-9ca02954bcd3 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:18.947784 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1703450f-89fb-4f46-b19e-9ca02954bcd3 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:18.953611 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1703450f-89fb-4f46-b19e-9ca02954bcd3 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:18.954449 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1703450f-89fb-4f46-b19e-9ca02954bcd3 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:18.958966 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1703450f-89fb-4f46-b19e-9ca02954bcd3 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:19.244852 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-1703450f-89fb-4f46-b19e-9ca02954bcd3 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:19.262781 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-1703450f-89fb-4f46-b19e-9ca02954bcd3 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1295 microversion: 2.1 time: 0.338084 Jun 23 22:36:19.269078 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 16/38] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:18 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1295 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:36:19.300485 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b4926cd9-0bf5-4a36-a2f0-c3354a932a3f tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:19.305857 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-b4926cd9-0bf5-4a36-a2f0-c3354a932a3f tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:19.349329 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b4926cd9-0bf5-4a36-a2f0-c3354a932a3f tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:19.363803 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b4926cd9-0bf5-4a36-a2f0-c3354a932a3f tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:19.365019 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b4926cd9-0bf5-4a36-a2f0-c3354a932a3f tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:19.373721 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b4926cd9-0bf5-4a36-a2f0-c3354a932a3f tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:19.896064 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b4926cd9-0bf5-4a36-a2f0-c3354a932a3f tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c519b28b174ef385dd7e76b85cf504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becdae52e5c64b1ea2bb05833505b0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:19.909546 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-b4926cd9-0bf5-4a36-a2f0-c3354a932a3f tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] 10.222.0.43 "GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de" status: 200 len: 1274 microversion: 2.1 time: 0.638083 Jun 23 22:36:19.912570 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 17/39] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:19 2022] GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de => generated 1274 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:19.927954 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-ee3573d7-d90d-432b-b23f-518a1b6deabb tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:19.928958 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-ee3573d7-d90d-432b-b23f-518a1b6deabb tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: cd22650e-6851-4f81-a8d4-e4c7ade26c73] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:19.944552 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ee3573d7-d90d-432b-b23f-518a1b6deabb tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:19.947026 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ee3573d7-d90d-432b-b23f-518a1b6deabb tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:19.949060 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ee3573d7-d90d-432b-b23f-518a1b6deabb tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:19.950267 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ee3573d7-d90d-432b-b23f-518a1b6deabb tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:20.212869 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ee3573d7-d90d-432b-b23f-518a1b6deabb tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:20.222788 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-ee3573d7-d90d-432b-b23f-518a1b6deabb tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73" status: 200 len: 1293 microversion: 2.1 time: 0.308519 Jun 23 22:36:20.223405 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 18/40] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:19 2022] GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73 => generated 1293 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:20.286602 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-38d89c1d-2f90-456f-8283-cfec5d1d0923 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:20.287786 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-38d89c1d-2f90-456f-8283-cfec5d1d0923 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:20.301225 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-38d89c1d-2f90-456f-8283-cfec5d1d0923 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:20.303187 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-38d89c1d-2f90-456f-8283-cfec5d1d0923 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:20.305754 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-38d89c1d-2f90-456f-8283-cfec5d1d0923 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:20.306463 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-38d89c1d-2f90-456f-8283-cfec5d1d0923 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:21.110268 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-38d89c1d-2f90-456f-8283-cfec5d1d0923 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:21.121882 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-38d89c1d-2f90-456f-8283-cfec5d1d0923 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1295 microversion: 2.1 time: 0.839816 Jun 23 22:36:21.128724 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 19/41] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:20 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1295 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:36:21.139230 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-5513b43a-041c-4bbc-a449-f852661c701d tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:21.142089 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-5513b43a-041c-4bbc-a449-f852661c701d tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:21.161312 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5513b43a-041c-4bbc-a449-f852661c701d tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:21.163663 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5513b43a-041c-4bbc-a449-f852661c701d tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:21.180677 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5513b43a-041c-4bbc-a449-f852661c701d tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:21.186396 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5513b43a-041c-4bbc-a449-f852661c701d tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:22.307140 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-5513b43a-041c-4bbc-a449-f852661c701d tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c519b28b174ef385dd7e76b85cf504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becdae52e5c64b1ea2bb05833505b0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:22.323427 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-5513b43a-041c-4bbc-a449-f852661c701d tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] 10.222.0.43 "GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de" status: 200 len: 1272 microversion: 2.1 time: 1.193148 Jun 23 22:36:22.324850 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 20/42] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:21 2022] GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de => generated 1272 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:22.337884 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-05ccfc0f-327f-4feb-863e-99b389b82d8d tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:22.339508 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-05ccfc0f-327f-4feb-863e-99b389b82d8d tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: cd22650e-6851-4f81-a8d4-e4c7ade26c73] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:22.355438 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-05ccfc0f-327f-4feb-863e-99b389b82d8d tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:22.356031 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-05ccfc0f-327f-4feb-863e-99b389b82d8d tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:22.357447 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-05ccfc0f-327f-4feb-863e-99b389b82d8d tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:22.364296 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-05ccfc0f-327f-4feb-863e-99b389b82d8d tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:22.811181 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-05ccfc0f-327f-4feb-863e-99b389b82d8d tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:22.821970 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-05ccfc0f-327f-4feb-863e-99b389b82d8d tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73" status: 200 len: 1299 microversion: 2.1 time: 0.495046 Jun 23 22:36:22.824863 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 21/43] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:22 2022] GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73 => generated 1299 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:22.851123 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-37c03651-5f2d-40f4-a543-e8b803a8710f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:22.854815 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-37c03651-5f2d-40f4-a543-e8b803a8710f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:22.875824 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-37c03651-5f2d-40f4-a543-e8b803a8710f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:22.878431 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-37c03651-5f2d-40f4-a543-e8b803a8710f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:22.879651 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-37c03651-5f2d-40f4-a543-e8b803a8710f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:22.883483 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-37c03651-5f2d-40f4-a543-e8b803a8710f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:23.694345 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-9dcba315-da5b-441f-9b28-ed73f7d32aec tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Flavor limits 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:36:23.694861 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-9dcba315-da5b-441f-9b28-ed73f7d32aec tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Image limits 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:36:23.695482 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-9dcba315-da5b-441f-9b28-ed73f7d32aec tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Flavor pref 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:36:23.696100 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-9dcba315-da5b-441f-9b28-ed73f7d32aec tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Image pref 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:36:23.697003 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-9dcba315-da5b-441f-9b28-ed73f7d32aec tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:36:23.702044 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=8 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:36:23.721160 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell0:SELECT=25 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:36:23.729155 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9dcba315-da5b-441f-9b28-ed73f7d32aec tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:23.730725 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9dcba315-da5b-441f-9b28-ed73f7d32aec tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:23.732433 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9dcba315-da5b-441f-9b28-ed73f7d32aec tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:23.736141 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9dcba315-da5b-441f-9b28-ed73f7d32aec tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:23.801312 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-9dcba315-da5b-441f-9b28-ed73f7d32aec tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Getting quotas for project 192d1c8d15ce462dbf10fc3b519ab253. Resources: {'instances', 'cores', 'ram'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:36:23.812487 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-9dcba315-da5b-441f-9b28-ed73f7d32aec tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Getting quotas for user dc246e144afc46698000f7f53ef6489e and project 192d1c8d15ce462dbf10fc3b519ab253. Resources: {'instances', 'cores', 'ram'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:36:23.860413 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-9dcba315-da5b-441f-9b28-ed73f7d32aec tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Going to run 1 instances... {{(pid=124357) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:36:23.865680 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-9dcba315-da5b-441f-9b28-ed73f7d32aec tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ac7d441e-2ac8-49ad-9dc5-3c55bd4b4f8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:36:23.957299 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-9dcba315-da5b-441f-9b28-ed73f7d32aec tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.786370 Jun 23 22:36:23.964133 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 23/44] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Jun 23 22:36:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 5794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 22:36:23.980308 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-cac6a5b3-0b5d-408e-a997-c219cc4e568f tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:23.983764 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-cac6a5b3-0b5d-408e-a997-c219cc4e568f tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:24.004398 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-cac6a5b3-0b5d-408e-a997-c219cc4e568f tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:24.006483 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-cac6a5b3-0b5d-408e-a997-c219cc4e568f tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:24.009318 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-cac6a5b3-0b5d-408e-a997-c219cc4e568f tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:24.011380 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-cac6a5b3-0b5d-408e-a997-c219cc4e568f tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:24.471559 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-37c03651-5f2d-40f4-a543-e8b803a8710f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:24.505902 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-37c03651-5f2d-40f4-a543-e8b803a8710f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1362 microversion: 2.1 time: 1.668926 Jun 23 22:36:24.511447 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 22/45] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:22 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1362 bytes in 1686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:24.565004 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c258369e-c299-4717-9006-1eacf5ca1abe tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:24.565752 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c258369e-c299-4717-9006-1eacf5ca1abe tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: cd22650e-6851-4f81-a8d4-e4c7ade26c73] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:24.585144 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-cac6a5b3-0b5d-408e-a997-c219cc4e568f tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c519b28b174ef385dd7e76b85cf504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becdae52e5c64b1ea2bb05833505b0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:24.610005 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-cac6a5b3-0b5d-408e-a997-c219cc4e568f tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] 10.222.0.43 "GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de" status: 200 len: 1272 microversion: 2.1 time: 0.644464 Jun 23 22:36:24.610592 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 24/46] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:23 2022] GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de => generated 1272 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:24.615821 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c258369e-c299-4717-9006-1eacf5ca1abe tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:24.616288 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c258369e-c299-4717-9006-1eacf5ca1abe tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:24.623453 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c258369e-c299-4717-9006-1eacf5ca1abe tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:24.624217 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c258369e-c299-4717-9006-1eacf5ca1abe tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:24.635185 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-40b11042-6370-44f5-8491-22ed94279eeb tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:24.643774 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-40b11042-6370-44f5-8491-22ed94279eeb tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:25.015307 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-40b11042-6370-44f5-8491-22ed94279eeb tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:25.024339 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-40b11042-6370-44f5-8491-22ed94279eeb tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1222 microversion: 2.1 time: 0.406104 Jun 23 22:36:25.036918 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 25/47] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:24 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1222 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:25.201969 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c258369e-c299-4717-9006-1eacf5ca1abe tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:25.222857 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c258369e-c299-4717-9006-1eacf5ca1abe tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73" status: 200 len: 1299 microversion: 2.1 time: 0.694689 Jun 23 22:36:25.229042 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 23/48] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:24 2022] GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73 => generated 1299 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:25.530959 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-01e054d3-84e1-49e1-b464-65cc8d82fcf0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:25.532254 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-01e054d3-84e1-49e1-b464-65cc8d82fcf0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:25.545727 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-01e054d3-84e1-49e1-b464-65cc8d82fcf0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:25.549638 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-01e054d3-84e1-49e1-b464-65cc8d82fcf0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:25.549638 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-01e054d3-84e1-49e1-b464-65cc8d82fcf0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:25.556274 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-01e054d3-84e1-49e1-b464-65cc8d82fcf0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:25.650988 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-88c2f591-3122-414a-b261-e2fe422f2bc5 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:25.651796 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-88c2f591-3122-414a-b261-e2fe422f2bc5 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:25.688903 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-88c2f591-3122-414a-b261-e2fe422f2bc5 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:25.690484 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-88c2f591-3122-414a-b261-e2fe422f2bc5 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:25.691516 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-88c2f591-3122-414a-b261-e2fe422f2bc5 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:25.692678 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-88c2f591-3122-414a-b261-e2fe422f2bc5 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:26.191420 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-88c2f591-3122-414a-b261-e2fe422f2bc5 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c519b28b174ef385dd7e76b85cf504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becdae52e5c64b1ea2bb05833505b0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:26.199822 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-88c2f591-3122-414a-b261-e2fe422f2bc5 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] 10.222.0.43 "GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de" status: 200 len: 1272 microversion: 2.1 time: 0.572903 Jun 23 22:36:26.201288 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 24/49] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:25 2022] GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de => generated 1272 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:26.214265 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-4526e656-f106-4aa5-a583-e96b8aea87a4 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:26.215615 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-4526e656-f106-4aa5-a583-e96b8aea87a4 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:26.232249 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4526e656-f106-4aa5-a583-e96b8aea87a4 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:26.235064 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4526e656-f106-4aa5-a583-e96b8aea87a4 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:26.236561 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4526e656-f106-4aa5-a583-e96b8aea87a4 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:26.240088 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4526e656-f106-4aa5-a583-e96b8aea87a4 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:26.515651 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=4 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:36:27.209223 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4526e656-f106-4aa5-a583-e96b8aea87a4 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:27.222309 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-4526e656-f106-4aa5-a583-e96b8aea87a4 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1274 microversion: 2.1 time: 1.019539 Jun 23 22:36:27.225682 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 25/50] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:26 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1274 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:27.239194 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-bae5c5cc-fc90-4659-8f02-05cb42f6f8fc tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:27.240910 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-bae5c5cc-fc90-4659-8f02-05cb42f6f8fc tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: cd22650e-6851-4f81-a8d4-e4c7ade26c73] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:27.265555 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bae5c5cc-fc90-4659-8f02-05cb42f6f8fc tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:27.266397 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bae5c5cc-fc90-4659-8f02-05cb42f6f8fc tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:27.267590 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bae5c5cc-fc90-4659-8f02-05cb42f6f8fc tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:27.268522 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bae5c5cc-fc90-4659-8f02-05cb42f6f8fc tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:28.282231 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-01e054d3-84e1-49e1-b464-65cc8d82fcf0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:28.316869 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-01e054d3-84e1-49e1-b464-65cc8d82fcf0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1362 microversion: 2.1 time: 2.790920 Jun 23 22:36:28.317515 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 26/51] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:25 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1362 bytes in 2793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:28.581198 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=14 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:36:28.615577 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-bae5c5cc-fc90-4659-8f02-05cb42f6f8fc tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:28.630948 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-bae5c5cc-fc90-4659-8f02-05cb42f6f8fc tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73" status: 200 len: 1367 microversion: 2.1 time: 1.403601 Jun 23 22:36:28.631552 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 26/52] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:27 2022] GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73 => generated 1367 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:28.645102 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-25dbc4dc-7981-4933-aafd-1013872e8c2b tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:28.649742 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-25dbc4dc-7981-4933-aafd-1013872e8c2b tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:28.668314 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-25dbc4dc-7981-4933-aafd-1013872e8c2b tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:28.670036 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-25dbc4dc-7981-4933-aafd-1013872e8c2b tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:28.673166 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-25dbc4dc-7981-4933-aafd-1013872e8c2b tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:28.675272 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-25dbc4dc-7981-4933-aafd-1013872e8c2b tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:28.809412 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [req-e31d6fca-bf6a-43de-b769-45b3a2b22d0f req-7927f8df-c842-4e5c-8bd6-588b1c6d79eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f910ba21-0126-4f09-8fd9-10f2365e67c1", "tag": "1d0ff831-0151-424d-bdac-c933fd397da7"}]} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:36:28.824718 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-e31d6fca-bf6a-43de-b769-45b3a2b22d0f req-7927f8df-c842-4e5c-8bd6-588b1c6d79eb service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:28.826133 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-e31d6fca-bf6a-43de-b769-45b3a2b22d0f req-7927f8df-c842-4e5c-8bd6-588b1c6d79eb service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:28.854177 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.compute.server_external_events [req-e31d6fca-bf6a-43de-b769-45b3a2b22d0f req-7927f8df-c842-4e5c-8bd6-588b1c6d79eb service nova] Creating event network-changed:1d0ff831-0151-424d-bdac-c933fd397da7 for instance f910ba21-0126-4f09-8fd9-10f2365e67c1 on hv-cinder-84617 Jun 23 22:36:28.881357 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-e31d6fca-bf6a-43de-b769-45b3a2b22d0f req-7927f8df-c842-4e5c-8bd6-588b1c6d79eb service nova] Acquired lock "compute-rpcapi-router" {{(pid=124357) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 23 22:36:28.887196 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d19d6c11-e3bb-4919-ae78-39909799d3f0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:28.890781 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d19d6c11-e3bb-4919-ae78-39909799d3f0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:28.899625 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d19d6c11-e3bb-4919-ae78-39909799d3f0 None None] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:28.900328 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d19d6c11-e3bb-4919-ae78-39909799d3f0 None None] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:28.951093 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.compute.rpcapi [None req-d19d6c11-e3bb-4919-ae78-39909799d3f0 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 23 22:36:28.953990 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d19d6c11-e3bb-4919-ae78-39909799d3f0 None None] Releasing lock "compute-rpcapi-router" {{(pid=124357) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 23 22:36:29.007708 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-d19d6c11-e3bb-4919-ae78-39909799d3f0 None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.687213 Jun 23 22:36:29.008948 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 27/53] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:36:29.016219 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-89a56bc0-c75f-4614-8c1d-3380bcf54ec1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:29.017549 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-89a56bc0-c75f-4614-8c1d-3380bcf54ec1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:29.033533 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-89a56bc0-c75f-4614-8c1d-3380bcf54ec1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:29.034194 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-89a56bc0-c75f-4614-8c1d-3380bcf54ec1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:29.035411 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-89a56bc0-c75f-4614-8c1d-3380bcf54ec1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:29.036056 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-89a56bc0-c75f-4614-8c1d-3380bcf54ec1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:29.769090 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-89a56bc0-c75f-4614-8c1d-3380bcf54ec1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:29.778529 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-89a56bc0-c75f-4614-8c1d-3380bcf54ec1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1322 microversion: 2.1 time: 0.768225 Jun 23 22:36:29.779368 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 28/54] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:29 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1322 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:29.791826 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-5301a9f3-0ecc-4925-b6ee-44c001bb0aa3 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:29.792668 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-5301a9f3-0ecc-4925-b6ee-44c001bb0aa3 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:29.799982 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5301a9f3-0ecc-4925-b6ee-44c001bb0aa3 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:29.800631 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5301a9f3-0ecc-4925-b6ee-44c001bb0aa3 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:29.801579 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5301a9f3-0ecc-4925-b6ee-44c001bb0aa3 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:29.802199 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5301a9f3-0ecc-4925-b6ee-44c001bb0aa3 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:29.843842 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-25dbc4dc-7981-4933-aafd-1013872e8c2b tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c519b28b174ef385dd7e76b85cf504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becdae52e5c64b1ea2bb05833505b0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:29.851573 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-25dbc4dc-7981-4933-aafd-1013872e8c2b tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] 10.222.0.43 "GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de" status: 200 len: 1314 microversion: 2.1 time: 1.217765 Jun 23 22:36:29.852475 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 27/55] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:28 2022] GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de => generated 1314 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:29.858192 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-7d9a4105-2364-482e-947f-99ebd20a85f0 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:29.858805 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-7d9a4105-2364-482e-947f-99ebd20a85f0 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: cd22650e-6851-4f81-a8d4-e4c7ade26c73] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:29.866088 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7d9a4105-2364-482e-947f-99ebd20a85f0 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:29.866739 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7d9a4105-2364-482e-947f-99ebd20a85f0 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:29.868207 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7d9a4105-2364-482e-947f-99ebd20a85f0 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:29.868644 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7d9a4105-2364-482e-947f-99ebd20a85f0 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:30.468085 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-5301a9f3-0ecc-4925-b6ee-44c001bb0aa3 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:30.481075 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-5301a9f3-0ecc-4925-b6ee-44c001bb0aa3 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1362 microversion: 2.1 time: 0.696577 Jun 23 22:36:30.495077 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 29/56] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:29 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1362 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:30.515195 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-7d9a4105-2364-482e-947f-99ebd20a85f0 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:30.535295 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-7d9a4105-2364-482e-947f-99ebd20a85f0 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73" status: 200 len: 1367 microversion: 2.1 time: 0.681504 Jun 23 22:36:30.550078 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 28/57] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:29 2022] GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73 => generated 1367 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:30.797916 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-437f6909-6bde-454e-8b28-2f678e09f666 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:30.798450 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-437f6909-6bde-454e-8b28-2f678e09f666 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:30.812767 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-437f6909-6bde-454e-8b28-2f678e09f666 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:30.813539 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-437f6909-6bde-454e-8b28-2f678e09f666 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:30.814451 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-437f6909-6bde-454e-8b28-2f678e09f666 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:30.814942 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-437f6909-6bde-454e-8b28-2f678e09f666 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:30.925533 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [req-199bed6e-aa8e-45a2-b8d1-6c8bb8cd0a74 req-b40a687e-5ee8-4d2c-92b7-26efbf4d66c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "903f0ba6-4cc4-4533-8e70-b8f58c13d4c4", "tag": "79ccfbc8-28e4-4313-8f45-8c693924dbde"}]} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:36:30.935926 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-199bed6e-aa8e-45a2-b8d1-6c8bb8cd0a74 req-b40a687e-5ee8-4d2c-92b7-26efbf4d66c3 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:30.936365 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-199bed6e-aa8e-45a2-b8d1-6c8bb8cd0a74 req-b40a687e-5ee8-4d2c-92b7-26efbf4d66c3 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:30.948964 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.compute.server_external_events [req-199bed6e-aa8e-45a2-b8d1-6c8bb8cd0a74 req-b40a687e-5ee8-4d2c-92b7-26efbf4d66c3 service nova] Creating event network-changed:79ccfbc8-28e4-4313-8f45-8c693924dbde for instance 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 on hv-cinder-84617 Jun 23 22:36:30.955051 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [req-199bed6e-aa8e-45a2-b8d1-6c8bb8cd0a74 req-b40a687e-5ee8-4d2c-92b7-26efbf4d66c3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.464747 Jun 23 22:36:30.955986 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 30/58] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:36:30.961666 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-a8f6f9fb-7d9b-4df8-8ab2-a34ab4628215 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:30.962627 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-a8f6f9fb-7d9b-4df8-8ab2-a34ab4628215 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:30.970857 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a8f6f9fb-7d9b-4df8-8ab2-a34ab4628215 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:30.971409 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a8f6f9fb-7d9b-4df8-8ab2-a34ab4628215 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:30.972173 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a8f6f9fb-7d9b-4df8-8ab2-a34ab4628215 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:30.972600 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a8f6f9fb-7d9b-4df8-8ab2-a34ab4628215 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:31.329764 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-437f6909-6bde-454e-8b28-2f678e09f666 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:31.335906 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=100 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:36:31.342242 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-437f6909-6bde-454e-8b28-2f678e09f666 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1322 microversion: 2.1 time: 0.549366 Jun 23 22:36:31.342829 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 29/59] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:30 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1322 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:36:31.375097 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-a8f6f9fb-7d9b-4df8-8ab2-a34ab4628215 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c519b28b174ef385dd7e76b85cf504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becdae52e5c64b1ea2bb05833505b0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:31.383783 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-a8f6f9fb-7d9b-4df8-8ab2-a34ab4628215 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] 10.222.0.43 "GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de" status: 200 len: 1314 microversion: 2.1 time: 0.426352 Jun 23 22:36:31.384550 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 31/60] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:30 2022] GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de => generated 1314 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:31.503320 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-886ea58d-e6c9-423e-82ed-17d032202ca6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:31.503721 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-886ea58d-e6c9-423e-82ed-17d032202ca6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:31.512094 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-886ea58d-e6c9-423e-82ed-17d032202ca6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:31.512471 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-886ea58d-e6c9-423e-82ed-17d032202ca6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:31.513599 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-886ea58d-e6c9-423e-82ed-17d032202ca6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:31.514182 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-886ea58d-e6c9-423e-82ed-17d032202ca6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:31.565901 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-c250e234-091c-4eae-a8eb-99e3eb8fb866 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:31.566536 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-c250e234-091c-4eae-a8eb-99e3eb8fb866 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: cd22650e-6851-4f81-a8d4-e4c7ade26c73] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:31.576006 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c250e234-091c-4eae-a8eb-99e3eb8fb866 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:31.581295 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c250e234-091c-4eae-a8eb-99e3eb8fb866 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:31.582483 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c250e234-091c-4eae-a8eb-99e3eb8fb866 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:31.583138 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c250e234-091c-4eae-a8eb-99e3eb8fb866 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:32.025717 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-c250e234-091c-4eae-a8eb-99e3eb8fb866 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:32.035460 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-886ea58d-e6c9-423e-82ed-17d032202ca6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:32.039889 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-c250e234-091c-4eae-a8eb-99e3eb8fb866 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73" status: 200 len: 1367 microversion: 2.1 time: 0.477862 Jun 23 22:36:32.046301 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-886ea58d-e6c9-423e-82ed-17d032202ca6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1362 microversion: 2.1 time: 0.545845 Jun 23 22:36:32.050692 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 30/61] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:31 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1362 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:32.057091 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 32/62] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:31 2022] GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73 => generated 1367 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:32.360258 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-86bb22b7-69e8-4a5d-948a-db9e4189453d tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:32.361451 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-86bb22b7-69e8-4a5d-948a-db9e4189453d tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:32.375640 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-86bb22b7-69e8-4a5d-948a-db9e4189453d tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:32.376344 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-86bb22b7-69e8-4a5d-948a-db9e4189453d tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:32.379978 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-86bb22b7-69e8-4a5d-948a-db9e4189453d tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:32.383917 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-86bb22b7-69e8-4a5d-948a-db9e4189453d tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:32.408859 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-3b3db385-f370-47de-bef9-03971b233143 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:32.409557 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-3b3db385-f370-47de-bef9-03971b233143 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:32.442145 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3b3db385-f370-47de-bef9-03971b233143 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:32.442600 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3b3db385-f370-47de-bef9-03971b233143 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:32.443440 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3b3db385-f370-47de-bef9-03971b233143 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:32.443874 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3b3db385-f370-47de-bef9-03971b233143 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:34.909839 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-86bb22b7-69e8-4a5d-948a-db9e4189453d tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:34.995726 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-86bb22b7-69e8-4a5d-948a-db9e4189453d tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1322 microversion: 2.1 time: 2.633697 Jun 23 22:36:35.001771 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 31/63] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:32 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1322 bytes in 2646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:35.023721 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell0:SELECT=7 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:36:35.039597 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-5746509b-817d-4a65-bd93-67f8bc2876dc tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:35.042662 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-5746509b-817d-4a65-bd93-67f8bc2876dc tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: cd22650e-6851-4f81-a8d4-e4c7ade26c73] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:35.093136 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5746509b-817d-4a65-bd93-67f8bc2876dc tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:35.099063 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5746509b-817d-4a65-bd93-67f8bc2876dc tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:35.100335 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5746509b-817d-4a65-bd93-67f8bc2876dc tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:35.101747 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5746509b-817d-4a65-bd93-67f8bc2876dc tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:35.147416 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-3b3db385-f370-47de-bef9-03971b233143 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c519b28b174ef385dd7e76b85cf504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becdae52e5c64b1ea2bb05833505b0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:35.180066 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-3b3db385-f370-47de-bef9-03971b233143 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] 10.222.0.43 "GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de" status: 200 len: 1314 microversion: 2.1 time: 2.769240 Jun 23 22:36:35.186374 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 33/64] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:32 2022] GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de => generated 1314 bytes in 2785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:35.205402 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-f9e9ab6b-91fe-41ed-a36a-1043b836c457 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:35.210438 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-f9e9ab6b-91fe-41ed-a36a-1043b836c457 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:35.223795 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f9e9ab6b-91fe-41ed-a36a-1043b836c457 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:35.224321 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f9e9ab6b-91fe-41ed-a36a-1043b836c457 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:35.225142 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f9e9ab6b-91fe-41ed-a36a-1043b836c457 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:35.225614 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f9e9ab6b-91fe-41ed-a36a-1043b836c457 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:36.186268 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-f9e9ab6b-91fe-41ed-a36a-1043b836c457 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:36.199411 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-f9e9ab6b-91fe-41ed-a36a-1043b836c457 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1362 microversion: 2.1 time: 1.009292 Jun 23 22:36:36.204172 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 34/65] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:35 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1362 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:36.211507 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-5746509b-817d-4a65-bd93-67f8bc2876dc tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:36.214118 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [req-12f9a583-7f6c-4580-aba9-3b069fb611af req-8ec06982-0afb-42c6-a8d4-2974899e9f1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd22650e-6851-4f81-a8d4-e4c7ade26c73", "tag": "e97c4f2f-223c-4f40-b688-f46dae13754f"}]} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:36:36.219797 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-5746509b-817d-4a65-bd93-67f8bc2876dc tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73" status: 200 len: 1367 microversion: 2.1 time: 1.215847 Jun 23 22:36:36.223031 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 32/66] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:35 2022] GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73 => generated 1367 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:36.236273 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-f774d7aa-3202-4099-8525-d20f701efee8 req-40b4fb24-52b3-4c2f-bd26-b82065433c35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eda9f458-d54a-46b6-a86a-884bc9d95a64", "tag": "db6ca92f-4e18-420e-8910-cb6285fa5c3d"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:36:36.251075 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-12f9a583-7f6c-4580-aba9-3b069fb611af req-8ec06982-0afb-42c6-a8d4-2974899e9f1d service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:36.256271 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-12f9a583-7f6c-4580-aba9-3b069fb611af req-8ec06982-0afb-42c6-a8d4-2974899e9f1d service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:36.267169 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-f774d7aa-3202-4099-8525-d20f701efee8 req-40b4fb24-52b3-4c2f-bd26-b82065433c35 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:36.272351 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-f774d7aa-3202-4099-8525-d20f701efee8 req-40b4fb24-52b3-4c2f-bd26-b82065433c35 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:36.299266 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.compute.server_external_events [req-12f9a583-7f6c-4580-aba9-3b069fb611af req-8ec06982-0afb-42c6-a8d4-2974899e9f1d service nova] Creating event network-changed:e97c4f2f-223c-4f40-b688-f46dae13754f for instance cd22650e-6851-4f81-a8d4-e4c7ade26c73 on hv-cinder-84617 Jun 23 22:36:36.305488 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [req-12f9a583-7f6c-4580-aba9-3b069fb611af req-8ec06982-0afb-42c6-a8d4-2974899e9f1d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099218 Jun 23 22:36:36.306393 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 35/67] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:36:36.310613 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-f774d7aa-3202-4099-8525-d20f701efee8 req-40b4fb24-52b3-4c2f-bd26-b82065433c35 service nova] Creating event network-changed:db6ca92f-4e18-420e-8910-cb6285fa5c3d for instance eda9f458-d54a-46b6-a86a-884bc9d95a64 on hv-cinder-84617 Jun 23 22:36:36.311301 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-f774d7aa-3202-4099-8525-d20f701efee8 req-40b4fb24-52b3-4c2f-bd26-b82065433c35 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124358) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 23 22:36:36.312865 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-37b9f22a-585d-4820-8940-b264812a1a0a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:36.313531 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-37b9f22a-585d-4820-8940-b264812a1a0a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:36.313890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-b3432da8-0444-4043-a41b-0553af10cc58 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:36.314724 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-b3432da8-0444-4043-a41b-0553af10cc58 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:36.315162 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-37b9f22a-585d-4820-8940-b264812a1a0a None None] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:36.315876 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-37b9f22a-585d-4820-8940-b264812a1a0a None None] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:36.324127 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-b3432da8-0444-4043-a41b-0553af10cc58 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:36.324951 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-b3432da8-0444-4043-a41b-0553af10cc58 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:36.326722 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-b3432da8-0444-4043-a41b-0553af10cc58 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:36.327618 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-b3432da8-0444-4043-a41b-0553af10cc58 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:36.334757 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.compute.rpcapi [None req-37b9f22a-585d-4820-8940-b264812a1a0a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 23 22:36:36.336003 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-37b9f22a-585d-4820-8940-b264812a1a0a None None] Releasing lock "compute-rpcapi-router" {{(pid=124358) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 23 22:36:36.368136 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-37b9f22a-585d-4820-8940-b264812a1a0a None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140632 Jun 23 22:36:36.368746 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 33/68] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:36:36.375932 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e94b09c5-17c2-43a0-91fc-8e1326853101 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:36.376717 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e94b09c5-17c2-43a0-91fc-8e1326853101 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:36.387061 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e94b09c5-17c2-43a0-91fc-8e1326853101 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:36.387523 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e94b09c5-17c2-43a0-91fc-8e1326853101 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:36.389087 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e94b09c5-17c2-43a0-91fc-8e1326853101 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:36.389526 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e94b09c5-17c2-43a0-91fc-8e1326853101 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:36.603242 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-b3432da8-0444-4043-a41b-0553af10cc58 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:36.612596 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-b3432da8-0444-4043-a41b-0553af10cc58 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1322 microversion: 2.1 time: 0.304614 Jun 23 22:36:36.627362 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 36/69] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:36 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1322 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:36.640299 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e94b09c5-17c2-43a0-91fc-8e1326853101 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c519b28b174ef385dd7e76b85cf504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becdae52e5c64b1ea2bb05833505b0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:36.649664 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e94b09c5-17c2-43a0-91fc-8e1326853101 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] 10.222.0.43 "GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de" status: 200 len: 1314 microversion: 2.1 time: 0.279476 Jun 23 22:36:36.651257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 34/70] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:36 2022] GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:37.221557 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-3e15f475-96a5-4990-9db2-fce8978d73de tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:37.223347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-3e15f475-96a5-4990-9db2-fce8978d73de tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:37.236729 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3e15f475-96a5-4990-9db2-fce8978d73de tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:37.237798 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3e15f475-96a5-4990-9db2-fce8978d73de tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:37.238396 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-7d80d2b1-a90f-469c-bedc-fccb80c5eadc tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:37.239720 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-7d80d2b1-a90f-469c-bedc-fccb80c5eadc tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: cd22650e-6851-4f81-a8d4-e4c7ade26c73] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:37.239939 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3e15f475-96a5-4990-9db2-fce8978d73de tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:37.240847 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3e15f475-96a5-4990-9db2-fce8978d73de tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:37.246050 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell1:SELECT=69 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:36:37.256668 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7d80d2b1-a90f-469c-bedc-fccb80c5eadc tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:37.258545 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7d80d2b1-a90f-469c-bedc-fccb80c5eadc tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:37.260138 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7d80d2b1-a90f-469c-bedc-fccb80c5eadc tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:37.262720 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7d80d2b1-a90f-469c-bedc-fccb80c5eadc tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:37.538611 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-7d80d2b1-a90f-469c-bedc-fccb80c5eadc tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:37.563695 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-7d80d2b1-a90f-469c-bedc-fccb80c5eadc tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73" status: 200 len: 1367 microversion: 2.1 time: 0.329748 Jun 23 22:36:37.566438 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 35/71] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:37 2022] GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73 => generated 1367 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:37.575173 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-3e15f475-96a5-4990-9db2-fce8978d73de tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:37.593319 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-3e15f475-96a5-4990-9db2-fce8978d73de tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1362 microversion: 2.1 time: 0.376084 Jun 23 22:36:37.594774 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 37/72] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:37 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1362 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:37.634599 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-7e956312-f73f-48df-94fd-b532f9176b50 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:37.638422 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-7e956312-f73f-48df-94fd-b532f9176b50 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:37.659514 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7e956312-f73f-48df-94fd-b532f9176b50 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:37.668461 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7e956312-f73f-48df-94fd-b532f9176b50 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:37.670685 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7e956312-f73f-48df-94fd-b532f9176b50 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:37.671111 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-b82443c1-2064-4150-a4ba-25d26d003081 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:37.672099 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-b82443c1-2064-4150-a4ba-25d26d003081 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:37.687286 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7e956312-f73f-48df-94fd-b532f9176b50 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:37.703611 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-b82443c1-2064-4150-a4ba-25d26d003081 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:37.706818 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-b82443c1-2064-4150-a4ba-25d26d003081 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:37.708133 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-b82443c1-2064-4150-a4ba-25d26d003081 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:37.709283 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-b82443c1-2064-4150-a4ba-25d26d003081 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:38.196088 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-7e956312-f73f-48df-94fd-b532f9176b50 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:38.208623 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-7e956312-f73f-48df-94fd-b532f9176b50 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1322 microversion: 2.1 time: 0.579559 Jun 23 22:36:38.222126 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-b82443c1-2064-4150-a4ba-25d26d003081 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c519b28b174ef385dd7e76b85cf504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becdae52e5c64b1ea2bb05833505b0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:38.224664 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 36/73] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:37 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1322 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:38.230952 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-b82443c1-2064-4150-a4ba-25d26d003081 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] 10.222.0.43 "GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de" status: 200 len: 1314 microversion: 2.1 time: 0.567187 Jun 23 22:36:38.232082 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 38/74] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:37 2022] GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:38.375645 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-a25573d1-9489-479e-a960-2fc93ad70bf8 req-25ed10fd-378e-4017-b3ff-a39a1e330cbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b0ce8c1-d950-47d0-a644-bf09bb09b7de", "tag": "c2d25909-b249-4e8a-bcb8-650a6616e3e6"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:36:38.386493 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-a25573d1-9489-479e-a960-2fc93ad70bf8 req-25ed10fd-378e-4017-b3ff-a39a1e330cbc service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:38.386964 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-a25573d1-9489-479e-a960-2fc93ad70bf8 req-25ed10fd-378e-4017-b3ff-a39a1e330cbc service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:38.402178 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-a25573d1-9489-479e-a960-2fc93ad70bf8 req-25ed10fd-378e-4017-b3ff-a39a1e330cbc service nova] Creating event network-changed:c2d25909-b249-4e8a-bcb8-650a6616e3e6 for instance 0b0ce8c1-d950-47d0-a644-bf09bb09b7de on hv-cinder-84617 Jun 23 22:36:38.408698 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-a25573d1-9489-479e-a960-2fc93ad70bf8 req-25ed10fd-378e-4017-b3ff-a39a1e330cbc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039468 Jun 23 22:36:38.409200 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 37/75] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:36:38.582835 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-df44e94a-2bda-4064-a94a-ca54d5518d4e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:38.583752 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-df44e94a-2bda-4064-a94a-ca54d5518d4e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: cd22650e-6851-4f81-a8d4-e4c7ade26c73] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:38.596901 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-df44e94a-2bda-4064-a94a-ca54d5518d4e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:38.597765 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-df44e94a-2bda-4064-a94a-ca54d5518d4e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:38.598911 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-df44e94a-2bda-4064-a94a-ca54d5518d4e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:38.599936 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-df44e94a-2bda-4064-a94a-ca54d5518d4e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:38.612921 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-ca022601-a97b-44b6-b582-040f8164abf6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:38.613533 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-ca022601-a97b-44b6-b582-040f8164abf6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:38.630700 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ca022601-a97b-44b6-b582-040f8164abf6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:38.631174 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ca022601-a97b-44b6-b582-040f8164abf6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:38.631955 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ca022601-a97b-44b6-b582-040f8164abf6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:38.632384 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ca022601-a97b-44b6-b582-040f8164abf6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:38.949732 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell0:SELECT=8 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:36:39.095681 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ca022601-a97b-44b6-b582-040f8164abf6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:39.107515 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-ca022601-a97b-44b6-b582-040f8164abf6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1362 microversion: 2.1 time: 0.497989 Jun 23 22:36:39.117857 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 38/76] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:38 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1362 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:39.134687 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-df44e94a-2bda-4064-a94a-ca54d5518d4e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:39.145392 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-df44e94a-2bda-4064-a94a-ca54d5518d4e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73" status: 200 len: 1367 microversion: 2.1 time: 0.566792 Jun 23 22:36:39.166959 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 39/77] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:38 2022] GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73 => generated 1367 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:39.246458 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c65129d6-2e40-4228-ade7-bc1e99bde2ec tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:39.248243 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c65129d6-2e40-4228-ade7-bc1e99bde2ec tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:39.254234 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-543ae81a-7faf-423b-a99a-641febc5aaf4 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:39.255186 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-543ae81a-7faf-423b-a99a-641febc5aaf4 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:39.259193 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c65129d6-2e40-4228-ade7-bc1e99bde2ec tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:39.260175 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c65129d6-2e40-4228-ade7-bc1e99bde2ec tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:39.261329 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c65129d6-2e40-4228-ade7-bc1e99bde2ec tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:39.262173 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c65129d6-2e40-4228-ade7-bc1e99bde2ec tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:39.264179 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-543ae81a-7faf-423b-a99a-641febc5aaf4 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:39.264713 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-543ae81a-7faf-423b-a99a-641febc5aaf4 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:39.265586 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-543ae81a-7faf-423b-a99a-641febc5aaf4 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:39.266021 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-543ae81a-7faf-423b-a99a-641febc5aaf4 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:39.671714 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c65129d6-2e40-4228-ade7-bc1e99bde2ec tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:39.683468 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c65129d6-2e40-4228-ade7-bc1e99bde2ec tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1322 microversion: 2.1 time: 0.447806 Jun 23 22:36:39.689268 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 39/78] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:39 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1322 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:39.930960 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-543ae81a-7faf-423b-a99a-641febc5aaf4 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c519b28b174ef385dd7e76b85cf504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becdae52e5c64b1ea2bb05833505b0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:39.948749 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-543ae81a-7faf-423b-a99a-641febc5aaf4 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] 10.222.0.43 "GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de" status: 200 len: 1314 microversion: 2.1 time: 0.698477 Jun 23 22:36:39.949637 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 40/79] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:39 2022] GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de => generated 1314 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:40.126579 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-bfb270b0-6096-48f5-9cee-dc81d2247e39 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:40.127630 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-bfb270b0-6096-48f5-9cee-dc81d2247e39 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:40.136667 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:36:40.142703 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bfb270b0-6096-48f5-9cee-dc81d2247e39 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:40.143339 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bfb270b0-6096-48f5-9cee-dc81d2247e39 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:40.145407 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bfb270b0-6096-48f5-9cee-dc81d2247e39 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:40.146828 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bfb270b0-6096-48f5-9cee-dc81d2247e39 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:40.176711 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-bf06e1d4-2253-47b6-a09e-633792c67ecb tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:40.177485 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-bf06e1d4-2253-47b6-a09e-633792c67ecb tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: cd22650e-6851-4f81-a8d4-e4c7ade26c73] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:40.189698 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-bf06e1d4-2253-47b6-a09e-633792c67ecb tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:40.192985 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-bf06e1d4-2253-47b6-a09e-633792c67ecb tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:40.193919 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-bf06e1d4-2253-47b6-a09e-633792c67ecb tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:40.194790 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-bf06e1d4-2253-47b6-a09e-633792c67ecb tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:40.500989 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-bfb270b0-6096-48f5-9cee-dc81d2247e39 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:40.510786 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-bfb270b0-6096-48f5-9cee-dc81d2247e39 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1362 microversion: 2.1 time: 0.389182 Jun 23 22:36:40.516945 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 40/80] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:40 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1362 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:40.573023 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-bf06e1d4-2253-47b6-a09e-633792c67ecb tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:40.583256 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-bf06e1d4-2253-47b6-a09e-633792c67ecb tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73" status: 200 len: 1367 microversion: 2.1 time: 0.413063 Jun 23 22:36:40.595671 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 41/81] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:40 2022] GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73 => generated 1367 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:40.712099 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-ca3aa23f-0ee1-4c46-ac3e-13d79b7e6849 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:40.712872 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-ca3aa23f-0ee1-4c46-ac3e-13d79b7e6849 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:40.728924 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ca3aa23f-0ee1-4c46-ac3e-13d79b7e6849 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:40.731188 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ca3aa23f-0ee1-4c46-ac3e-13d79b7e6849 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:40.733280 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ca3aa23f-0ee1-4c46-ac3e-13d79b7e6849 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:40.736167 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ca3aa23f-0ee1-4c46-ac3e-13d79b7e6849 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:40.815253 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-9a84cca0-d310-4300-a598-7012f0c0c25a req-e2791d42-52af-4cc5-bd68-907d8e53c67a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f910ba21-0126-4f09-8fd9-10f2365e67c1", "name": "network-vif-plugged", "status": "completed", "tag": "1d0ff831-0151-424d-bdac-c933fd397da7"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:36:40.848449 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-9a84cca0-d310-4300-a598-7012f0c0c25a req-e2791d42-52af-4cc5-bd68-907d8e53c67a service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:40.849675 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-9a84cca0-d310-4300-a598-7012f0c0c25a req-e2791d42-52af-4cc5-bd68-907d8e53c67a service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:40.884609 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-9a84cca0-d310-4300-a598-7012f0c0c25a req-e2791d42-52af-4cc5-bd68-907d8e53c67a service nova] Creating event network-vif-plugged:1d0ff831-0151-424d-bdac-c933fd397da7 for instance f910ba21-0126-4f09-8fd9-10f2365e67c1 on hv-cinder-84617 Jun 23 22:36:40.906915 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-9a84cca0-d310-4300-a598-7012f0c0c25a req-e2791d42-52af-4cc5-bd68-907d8e53c67a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.387234 Jun 23 22:36:40.910300 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 41/82] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:36:40.971527 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-824698d1-ca0a-4a6a-a783-b5403fde268a tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:40.972717 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-824698d1-ca0a-4a6a-a783-b5403fde268a tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:41.003395 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-824698d1-ca0a-4a6a-a783-b5403fde268a tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:41.008632 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-824698d1-ca0a-4a6a-a783-b5403fde268a tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:41.009776 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-824698d1-ca0a-4a6a-a783-b5403fde268a tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:41.010629 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-824698d1-ca0a-4a6a-a783-b5403fde268a tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:41.451231 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-ca3aa23f-0ee1-4c46-ac3e-13d79b7e6849 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:41.470648 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-ca3aa23f-0ee1-4c46-ac3e-13d79b7e6849 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1322 microversion: 2.1 time: 0.764756 Jun 23 22:36:41.471361 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 42/83] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:40 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1322 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:41.535643 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-06c38010-0211-4f84-b0f7-eefa668941a6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:41.536684 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-06c38010-0211-4f84-b0f7-eefa668941a6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:41.546289 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-06c38010-0211-4f84-b0f7-eefa668941a6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:41.552475 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-06c38010-0211-4f84-b0f7-eefa668941a6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:41.564927 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-06c38010-0211-4f84-b0f7-eefa668941a6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:41.565634 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-06c38010-0211-4f84-b0f7-eefa668941a6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:41.904485 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-824698d1-ca0a-4a6a-a783-b5403fde268a tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c519b28b174ef385dd7e76b85cf504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becdae52e5c64b1ea2bb05833505b0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:41.931370 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-824698d1-ca0a-4a6a-a783-b5403fde268a tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] 10.222.0.43 "GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de" status: 200 len: 1314 microversion: 2.1 time: 0.967595 Jun 23 22:36:41.933394 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 42/84] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:40 2022] GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de => generated 1314 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:41.939656 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-66e2909e-c3c1-4c67-b2ec-bed25675c2ec tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:41.954031 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-66e2909e-c3c1-4c67-b2ec-bed25675c2ec tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: cd22650e-6851-4f81-a8d4-e4c7ade26c73] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:41.989125 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-66e2909e-c3c1-4c67-b2ec-bed25675c2ec tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:41.989586 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-66e2909e-c3c1-4c67-b2ec-bed25675c2ec tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:41.993553 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-66e2909e-c3c1-4c67-b2ec-bed25675c2ec tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:41.999333 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-66e2909e-c3c1-4c67-b2ec-bed25675c2ec tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:42.314577 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-06c38010-0211-4f84-b0f7-eefa668941a6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:42.323536 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-06c38010-0211-4f84-b0f7-eefa668941a6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1362 microversion: 2.1 time: 0.793803 Jun 23 22:36:42.333767 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 43/85] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:41 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1362 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:42.448980 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-66e2909e-c3c1-4c67-b2ec-bed25675c2ec tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:42.460489 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-66e2909e-c3c1-4c67-b2ec-bed25675c2ec tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73" status: 200 len: 1367 microversion: 2.1 time: 0.524691 Jun 23 22:36:42.461069 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 43/86] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:41 2022] GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73 => generated 1367 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:42.487995 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-da0613f3-0e5c-40f4-a9ec-3943c0e55f84 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:42.489377 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-da0613f3-0e5c-40f4-a9ec-3943c0e55f84 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:42.495531 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-da0613f3-0e5c-40f4-a9ec-3943c0e55f84 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:42.495983 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-da0613f3-0e5c-40f4-a9ec-3943c0e55f84 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:42.496954 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-da0613f3-0e5c-40f4-a9ec-3943c0e55f84 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:42.498490 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-da0613f3-0e5c-40f4-a9ec-3943c0e55f84 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:42.686967 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-da0613f3-0e5c-40f4-a9ec-3943c0e55f84 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:42.694802 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-da0613f3-0e5c-40f4-a9ec-3943c0e55f84 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1322 microversion: 2.1 time: 0.210596 Jun 23 22:36:42.695494 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 44/87] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:42 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:42.951076 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-90a7838d-902d-4c94-885c-029a7d3757e5 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:42.952788 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-90a7838d-902d-4c94-885c-029a7d3757e5 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:42.968114 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-90a7838d-902d-4c94-885c-029a7d3757e5 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:42.969405 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-90a7838d-902d-4c94-885c-029a7d3757e5 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:42.970408 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-90a7838d-902d-4c94-885c-029a7d3757e5 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:42.971096 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-90a7838d-902d-4c94-885c-029a7d3757e5 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:43.173205 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-90a7838d-902d-4c94-885c-029a7d3757e5 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c519b28b174ef385dd7e76b85cf504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becdae52e5c64b1ea2bb05833505b0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:43.194576 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-90a7838d-902d-4c94-885c-029a7d3757e5 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] 10.222.0.43 "GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de" status: 200 len: 1314 microversion: 2.1 time: 0.248090 Jun 23 22:36:43.205029 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 44/88] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:42 2022] GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:43.340586 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-ac2e437c-ae17-48de-b221-84afa09ed3cc tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:43.342859 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-ac2e437c-ae17-48de-b221-84afa09ed3cc tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:43.351328 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ac2e437c-ae17-48de-b221-84afa09ed3cc tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:43.351779 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ac2e437c-ae17-48de-b221-84afa09ed3cc tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:43.352721 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ac2e437c-ae17-48de-b221-84afa09ed3cc tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:43.353199 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ac2e437c-ae17-48de-b221-84afa09ed3cc tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:43.480036 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f09e7abe-d028-468b-a7c8-529ce5786aed tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:43.480653 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-f09e7abe-d028-468b-a7c8-529ce5786aed tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: cd22650e-6851-4f81-a8d4-e4c7ade26c73] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:43.486248 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-ac2e437c-ae17-48de-b221-84afa09ed3cc tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:43.487401 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f09e7abe-d028-468b-a7c8-529ce5786aed tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:43.487848 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f09e7abe-d028-468b-a7c8-529ce5786aed tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:43.488621 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f09e7abe-d028-468b-a7c8-529ce5786aed tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:43.489054 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f09e7abe-d028-468b-a7c8-529ce5786aed tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:43.493934 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-ac2e437c-ae17-48de-b221-84afa09ed3cc tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1362 microversion: 2.1 time: 0.157212 Jun 23 22:36:43.494499 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 45/89] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:43 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:43.625330 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f09e7abe-d028-468b-a7c8-529ce5786aed tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:43.632740 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f09e7abe-d028-468b-a7c8-529ce5786aed tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73" status: 200 len: 1367 microversion: 2.1 time: 0.156535 Jun 23 22:36:43.633310 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 45/90] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:43 2022] GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:36:43.712104 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-866a8fae-5058-409d-ba62-3e92a5a8ed64 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:43.712704 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-866a8fae-5058-409d-ba62-3e92a5a8ed64 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:43.719505 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-866a8fae-5058-409d-ba62-3e92a5a8ed64 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:43.719951 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-866a8fae-5058-409d-ba62-3e92a5a8ed64 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:43.720713 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-866a8fae-5058-409d-ba62-3e92a5a8ed64 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:43.721143 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-866a8fae-5058-409d-ba62-3e92a5a8ed64 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:43.851919 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-866a8fae-5058-409d-ba62-3e92a5a8ed64 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:43.859320 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-866a8fae-5058-409d-ba62-3e92a5a8ed64 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1322 microversion: 2.1 time: 0.151119 Jun 23 22:36:43.859879 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 46/91] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:43 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:44.211761 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-63cccc2c-4607-4878-b305-075bd7ce2f4c tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:44.212383 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-63cccc2c-4607-4878-b305-075bd7ce2f4c tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:44.219149 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-63cccc2c-4607-4878-b305-075bd7ce2f4c tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:44.219596 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-63cccc2c-4607-4878-b305-075bd7ce2f4c tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:44.220367 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-63cccc2c-4607-4878-b305-075bd7ce2f4c tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:44.220803 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-63cccc2c-4607-4878-b305-075bd7ce2f4c tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:44.398614 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-63cccc2c-4607-4878-b305-075bd7ce2f4c tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c519b28b174ef385dd7e76b85cf504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becdae52e5c64b1ea2bb05833505b0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:44.407351 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-63cccc2c-4607-4878-b305-075bd7ce2f4c tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] 10.222.0.43 "GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de" status: 200 len: 1314 microversion: 2.1 time: 0.199295 Jun 23 22:36:44.417244 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 46/92] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:44 2022] GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:44.439007 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [req-6b767b94-087c-4498-b321-8f9535899920 req-570bdcc9-b100-4dd5-8246-7dffb57319dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b0ce8c1-d950-47d0-a644-bf09bb09b7de", "name": "network-vif-plugged", "status": "completed", "tag": "c2d25909-b249-4e8a-bcb8-650a6616e3e6"}]} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:36:44.449730 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-6b767b94-087c-4498-b321-8f9535899920 req-570bdcc9-b100-4dd5-8246-7dffb57319dd service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:44.451629 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-6b767b94-087c-4498-b321-8f9535899920 req-570bdcc9-b100-4dd5-8246-7dffb57319dd service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:44.465535 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.compute.server_external_events [req-6b767b94-087c-4498-b321-8f9535899920 req-570bdcc9-b100-4dd5-8246-7dffb57319dd service nova] Creating event network-vif-plugged:c2d25909-b249-4e8a-bcb8-650a6616e3e6 for instance 0b0ce8c1-d950-47d0-a644-bf09bb09b7de on hv-cinder-84617 Jun 23 22:36:44.472263 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [req-6b767b94-087c-4498-b321-8f9535899920 req-570bdcc9-b100-4dd5-8246-7dffb57319dd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038388 Jun 23 22:36:44.473302 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 47/93] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:36:44.510619 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-fbf97f4a-7d92-404e-a76c-eddc58330b5e tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:44.511405 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-fbf97f4a-7d92-404e-a76c-eddc58330b5e tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:44.523505 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fbf97f4a-7d92-404e-a76c-eddc58330b5e tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:44.525013 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fbf97f4a-7d92-404e-a76c-eddc58330b5e tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:44.527328 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fbf97f4a-7d92-404e-a76c-eddc58330b5e tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:44.528933 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fbf97f4a-7d92-404e-a76c-eddc58330b5e tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:44.651231 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-430413ee-cb95-4ae5-875b-8e6b2adeb5d1 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:44.652005 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-430413ee-cb95-4ae5-875b-8e6b2adeb5d1 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: cd22650e-6851-4f81-a8d4-e4c7ade26c73] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:44.669534 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-430413ee-cb95-4ae5-875b-8e6b2adeb5d1 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:44.670151 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-430413ee-cb95-4ae5-875b-8e6b2adeb5d1 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:44.671228 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-430413ee-cb95-4ae5-875b-8e6b2adeb5d1 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:44.671735 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-430413ee-cb95-4ae5-875b-8e6b2adeb5d1 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:44.927274 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-fbf97f4a-7d92-404e-a76c-eddc58330b5e tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:44.940656 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-fbf97f4a-7d92-404e-a76c-eddc58330b5e tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1362 microversion: 2.1 time: 0.433548 Jun 23 22:36:44.942381 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 47/94] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:44 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1362 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:44.955329 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-1ec0c975-55ec-4e97-9e7f-84a5174d7fbc tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:44.955941 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-1ec0c975-55ec-4e97-9e7f-84a5174d7fbc tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:44.963759 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1ec0c975-55ec-4e97-9e7f-84a5174d7fbc tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:44.964375 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1ec0c975-55ec-4e97-9e7f-84a5174d7fbc tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:44.965315 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1ec0c975-55ec-4e97-9e7f-84a5174d7fbc tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:44.965789 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1ec0c975-55ec-4e97-9e7f-84a5174d7fbc tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:44.971190 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=100 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:36:44.982958 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-430413ee-cb95-4ae5-875b-8e6b2adeb5d1 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:44.991490 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-430413ee-cb95-4ae5-875b-8e6b2adeb5d1 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73" status: 200 len: 1367 microversion: 2.1 time: 0.344438 Jun 23 22:36:45.001618 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 48/95] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:44 2022] GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73 => generated 1367 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:36:45.326896 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-1ec0c975-55ec-4e97-9e7f-84a5174d7fbc tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:45.334446 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-1ec0c975-55ec-4e97-9e7f-84a5174d7fbc tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1322 microversion: 2.1 time: 0.390747 Jun 23 22:36:45.335033 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 48/96] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:44 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1322 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:45.425203 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-5f3749ab-62fe-4c49-8872-c4f84c6f1b70 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:45.426134 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-5f3749ab-62fe-4c49-8872-c4f84c6f1b70 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:45.433369 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5f3749ab-62fe-4c49-8872-c4f84c6f1b70 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:45.433808 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5f3749ab-62fe-4c49-8872-c4f84c6f1b70 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:45.434749 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5f3749ab-62fe-4c49-8872-c4f84c6f1b70 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:45.435151 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5f3749ab-62fe-4c49-8872-c4f84c6f1b70 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:45.561771 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-5f3749ab-62fe-4c49-8872-c4f84c6f1b70 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c519b28b174ef385dd7e76b85cf504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becdae52e5c64b1ea2bb05833505b0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:45.569239 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-5f3749ab-62fe-4c49-8872-c4f84c6f1b70 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] 10.222.0.43 "GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de" status: 200 len: 1314 microversion: 2.1 time: 0.148595 Jun 23 22:36:45.569805 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 49/97] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:45 2022] GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:45.958705 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a2daa531-bf17-49b3-8542-aa9d35f7ac4e tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:45.959342 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-a2daa531-bf17-49b3-8542-aa9d35f7ac4e tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:45.965624 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a2daa531-bf17-49b3-8542-aa9d35f7ac4e tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:45.966074 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a2daa531-bf17-49b3-8542-aa9d35f7ac4e tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:45.966945 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a2daa531-bf17-49b3-8542-aa9d35f7ac4e tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:45.967396 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a2daa531-bf17-49b3-8542-aa9d35f7ac4e tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:46.009052 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-08f08775-e817-467b-9906-17fec726012c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:46.009687 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-08f08775-e817-467b-9906-17fec726012c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: cd22650e-6851-4f81-a8d4-e4c7ade26c73] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:46.015712 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-08f08775-e817-467b-9906-17fec726012c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:46.016157 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-08f08775-e817-467b-9906-17fec726012c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:46.016927 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-08f08775-e817-467b-9906-17fec726012c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:46.017360 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-08f08775-e817-467b-9906-17fec726012c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:46.152191 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-a2daa531-bf17-49b3-8542-aa9d35f7ac4e tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:46.160628 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-a2daa531-bf17-49b3-8542-aa9d35f7ac4e tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1548 microversion: 2.1 time: 0.205721 Jun 23 22:36:46.161290 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 49/98] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:45 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1548 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:46.177452 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-4de5f5e7-b144-44df-b0ba-e93259f46640 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:46.177936 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-4de5f5e7-b144-44df-b0ba-e93259f46640 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:46.178954 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-08f08775-e817-467b-9906-17fec726012c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:46.183859 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4de5f5e7-b144-44df-b0ba-e93259f46640 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:46.184288 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4de5f5e7-b144-44df-b0ba-e93259f46640 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:46.185122 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4de5f5e7-b144-44df-b0ba-e93259f46640 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:46.185537 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4de5f5e7-b144-44df-b0ba-e93259f46640 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:46.186290 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-08f08775-e817-467b-9906-17fec726012c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73" status: 200 len: 1367 microversion: 2.1 time: 0.181107 Jun 23 22:36:46.186853 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 50/99] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:46 2022] GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:36:46.296196 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-4de5f5e7-b144-44df-b0ba-e93259f46640 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.122359 Jun 23 22:36:46.296796 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 50/100] 10.222.0.43 () {58 vars in 1274 bytes} [Thu Jun 23 22:36:46 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:36:46.352617 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-29fec50c-6688-466c-a52f-2ce04c6daf5a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:46.353150 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-29fec50c-6688-466c-a52f-2ce04c6daf5a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:46.359482 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-29fec50c-6688-466c-a52f-2ce04c6daf5a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:46.359954 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-29fec50c-6688-466c-a52f-2ce04c6daf5a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:46.360707 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-29fec50c-6688-466c-a52f-2ce04c6daf5a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:46.361133 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-29fec50c-6688-466c-a52f-2ce04c6daf5a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:46.535127 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-f398f711-7ea5-4075-9b9c-c49174961cf8 req-1cef432d-7a44-4afe-ad0b-bbf67c47f5d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd22650e-6851-4f81-a8d4-e4c7ade26c73", "name": "network-vif-plugged", "status": "completed", "tag": "e97c4f2f-223c-4f40-b688-f46dae13754f"}, {"server_uuid": "eda9f458-d54a-46b6-a86a-884bc9d95a64", "name": "network-vif-plugged", "status": "completed", "tag": "db6ca92f-4e18-420e-8910-cb6285fa5c3d"}, {"server_uuid": "903f0ba6-4cc4-4533-8e70-b8f58c13d4c4", "name": "network-vif-plugged", "status": "completed", "tag": "79ccfbc8-28e4-4313-8f45-8c693924dbde"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:36:46.539935 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=2 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:36:46.548928 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-f398f711-7ea5-4075-9b9c-c49174961cf8 req-1cef432d-7a44-4afe-ad0b-bbf67c47f5d4 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:46.549427 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-f398f711-7ea5-4075-9b9c-c49174961cf8 req-1cef432d-7a44-4afe-ad0b-bbf67c47f5d4 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:46.565808 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-f398f711-7ea5-4075-9b9c-c49174961cf8 req-1cef432d-7a44-4afe-ad0b-bbf67c47f5d4 service nova] Creating event network-vif-plugged:e97c4f2f-223c-4f40-b688-f46dae13754f for instance cd22650e-6851-4f81-a8d4-e4c7ade26c73 on hv-cinder-84617 Jun 23 22:36:46.566322 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-f398f711-7ea5-4075-9b9c-c49174961cf8 req-1cef432d-7a44-4afe-ad0b-bbf67c47f5d4 service nova] Creating event network-vif-plugged:db6ca92f-4e18-420e-8910-cb6285fa5c3d for instance eda9f458-d54a-46b6-a86a-884bc9d95a64 on hv-cinder-84617 Jun 23 22:36:46.566822 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-f398f711-7ea5-4075-9b9c-c49174961cf8 req-1cef432d-7a44-4afe-ad0b-bbf67c47f5d4 service nova] Creating event network-vif-plugged:79ccfbc8-28e4-4313-8f45-8c693924dbde for instance 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 on hv-cinder-84617 Jun 23 22:36:46.574917 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-f398f711-7ea5-4075-9b9c-c49174961cf8 req-1cef432d-7a44-4afe-ad0b-bbf67c47f5d4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.043813 Jun 23 22:36:46.576280 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 51/101] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:36:46.585894 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-adfc98b6-af8f-45bf-bbd4-6078dbec7749 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:46.586819 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-adfc98b6-af8f-45bf-bbd4-6078dbec7749 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:46.593821 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-adfc98b6-af8f-45bf-bbd4-6078dbec7749 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:46.594256 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-adfc98b6-af8f-45bf-bbd4-6078dbec7749 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:46.595195 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-adfc98b6-af8f-45bf-bbd4-6078dbec7749 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:46.595622 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-adfc98b6-af8f-45bf-bbd4-6078dbec7749 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:46.646446 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-29fec50c-6688-466c-a52f-2ce04c6daf5a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:46.656910 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-29fec50c-6688-466c-a52f-2ce04c6daf5a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1322 microversion: 2.1 time: 0.308112 Jun 23 22:36:46.666815 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 51/102] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:46 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1322 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:46.889737 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-adfc98b6-af8f-45bf-bbd4-6078dbec7749 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c519b28b174ef385dd7e76b85cf504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becdae52e5c64b1ea2bb05833505b0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:46.897049 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-adfc98b6-af8f-45bf-bbd4-6078dbec7749 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] 10.222.0.43 "GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de" status: 200 len: 1314 microversion: 2.1 time: 0.315299 Jun 23 22:36:46.897643 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 52/103] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:46 2022] GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:36:47.203717 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-f98a5cbe-b212-4c5a-849b-670e6af11d93 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:47.204311 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-f98a5cbe-b212-4c5a-849b-670e6af11d93 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: cd22650e-6851-4f81-a8d4-e4c7ade26c73] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:47.210395 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f98a5cbe-b212-4c5a-849b-670e6af11d93 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:47.210830 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f98a5cbe-b212-4c5a-849b-670e6af11d93 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:47.211615 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f98a5cbe-b212-4c5a-849b-670e6af11d93 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:47.212039 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f98a5cbe-b212-4c5a-849b-670e6af11d93 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:47.653782 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-f98a5cbe-b212-4c5a-849b-670e6af11d93 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:47.664342 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-f98a5cbe-b212-4c5a-849b-670e6af11d93 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73" status: 200 len: 1367 microversion: 2.1 time: 0.464701 Jun 23 22:36:47.665412 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 52/104] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:47 2022] GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73 => generated 1367 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:47.680130 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-8c73adfa-dbde-455e-9938-b4bdde67dbe0 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:47.680952 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-8c73adfa-dbde-455e-9938-b4bdde67dbe0 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:47.699688 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8c73adfa-dbde-455e-9938-b4bdde67dbe0 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:47.700394 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8c73adfa-dbde-455e-9938-b4bdde67dbe0 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:47.701129 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8c73adfa-dbde-455e-9938-b4bdde67dbe0 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:47.703132 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8c73adfa-dbde-455e-9938-b4bdde67dbe0 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:47.916483 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-1313e776-5ad2-4e29-bc4f-5adba52af798 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:47.917549 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-1313e776-5ad2-4e29-bc4f-5adba52af798 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:47.925557 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1313e776-5ad2-4e29-bc4f-5adba52af798 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:47.925996 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1313e776-5ad2-4e29-bc4f-5adba52af798 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:47.926759 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1313e776-5ad2-4e29-bc4f-5adba52af798 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:47.927371 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1313e776-5ad2-4e29-bc4f-5adba52af798 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:48.037160 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-8c73adfa-dbde-455e-9938-b4bdde67dbe0 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:48.045941 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-8c73adfa-dbde-455e-9938-b4bdde67dbe0 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1322 microversion: 2.1 time: 0.375233 Jun 23 22:36:48.051444 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 53/105] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:47 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1322 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:48.201514 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-c145bd91-c626-4c6f-ac05-9a5a311e9b66 req-54bcb21a-dbd7-432f-bdfb-5d6f97359cad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f910ba21-0126-4f09-8fd9-10f2365e67c1", "tag": "1d0ff831-0151-424d-bdac-c933fd397da7"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:36:48.215294 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-c145bd91-c626-4c6f-ac05-9a5a311e9b66 req-54bcb21a-dbd7-432f-bdfb-5d6f97359cad service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:48.219753 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-c145bd91-c626-4c6f-ac05-9a5a311e9b66 req-54bcb21a-dbd7-432f-bdfb-5d6f97359cad service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:48.220642 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-1313e776-5ad2-4e29-bc4f-5adba52af798 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c519b28b174ef385dd7e76b85cf504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becdae52e5c64b1ea2bb05833505b0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:48.229237 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-1313e776-5ad2-4e29-bc4f-5adba52af798 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] 10.222.0.43 "GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de" status: 200 len: 1314 microversion: 2.1 time: 0.317897 Jun 23 22:36:48.230284 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 53/106] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:47 2022] GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:48.244273 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-c145bd91-c626-4c6f-ac05-9a5a311e9b66 req-54bcb21a-dbd7-432f-bdfb-5d6f97359cad service nova] Creating event network-changed:1d0ff831-0151-424d-bdac-c933fd397da7 for instance f910ba21-0126-4f09-8fd9-10f2365e67c1 on hv-cinder-84617 Jun 23 22:36:48.253540 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-c145bd91-c626-4c6f-ac05-9a5a311e9b66 req-54bcb21a-dbd7-432f-bdfb-5d6f97359cad service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060353 Jun 23 22:36:48.254234 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 54/107] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:36:48.682045 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-b3d2926b-80f3-4eed-88b2-7b8a72f984a5 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:48.682652 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-b3d2926b-80f3-4eed-88b2-7b8a72f984a5 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: cd22650e-6851-4f81-a8d4-e4c7ade26c73] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:48.688635 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-b3d2926b-80f3-4eed-88b2-7b8a72f984a5 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:48.689071 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-b3d2926b-80f3-4eed-88b2-7b8a72f984a5 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:48.689813 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-b3d2926b-80f3-4eed-88b2-7b8a72f984a5 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:48.690238 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-b3d2926b-80f3-4eed-88b2-7b8a72f984a5 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:48.705010 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell1:SELECT=100 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:36:48.824605 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-b3d2926b-80f3-4eed-88b2-7b8a72f984a5 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:48.832562 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-b3d2926b-80f3-4eed-88b2-7b8a72f984a5 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73" status: 200 len: 1367 microversion: 2.1 time: 0.154287 Jun 23 22:36:48.833253 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 54/108] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:48 2022] GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:49.064689 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-92d2cc7a-5ede-45ce-80a1-d58b1339edd3 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:49.065527 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-92d2cc7a-5ede-45ce-80a1-d58b1339edd3 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:49.071758 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-92d2cc7a-5ede-45ce-80a1-d58b1339edd3 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:49.072195 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-92d2cc7a-5ede-45ce-80a1-d58b1339edd3 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:49.072943 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-92d2cc7a-5ede-45ce-80a1-d58b1339edd3 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:49.073461 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-92d2cc7a-5ede-45ce-80a1-d58b1339edd3 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:49.212189 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-92d2cc7a-5ede-45ce-80a1-d58b1339edd3 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:49.220398 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-92d2cc7a-5ede-45ce-80a1-d58b1339edd3 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1322 microversion: 2.1 time: 0.160347 Jun 23 22:36:49.220962 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 55/109] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:49 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:49.248114 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-71ae241b-62fd-48be-87e4-4aaf5bc90470 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:49.248927 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-71ae241b-62fd-48be-87e4-4aaf5bc90470 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:49.255359 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-71ae241b-62fd-48be-87e4-4aaf5bc90470 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:49.255800 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-71ae241b-62fd-48be-87e4-4aaf5bc90470 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:49.256553 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-71ae241b-62fd-48be-87e4-4aaf5bc90470 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:49.256981 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-71ae241b-62fd-48be-87e4-4aaf5bc90470 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:49.390573 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-71ae241b-62fd-48be-87e4-4aaf5bc90470 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c519b28b174ef385dd7e76b85cf504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becdae52e5c64b1ea2bb05833505b0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:49.398574 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-71ae241b-62fd-48be-87e4-4aaf5bc90470 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] 10.222.0.43 "GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de" status: 200 len: 1314 microversion: 2.1 time: 0.154577 Jun 23 22:36:49.399679 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 55/110] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:49 2022] GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:49.848799 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-5974137b-5ab4-45e9-a57e-056bdcdd33d8 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:49.849407 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-5974137b-5ab4-45e9-a57e-056bdcdd33d8 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: cd22650e-6851-4f81-a8d4-e4c7ade26c73] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:49.855610 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5974137b-5ab4-45e9-a57e-056bdcdd33d8 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:49.856105 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5974137b-5ab4-45e9-a57e-056bdcdd33d8 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:49.857043 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5974137b-5ab4-45e9-a57e-056bdcdd33d8 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:49.857484 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5974137b-5ab4-45e9-a57e-056bdcdd33d8 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:49.986866 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-5974137b-5ab4-45e9-a57e-056bdcdd33d8 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:49.994270 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-5974137b-5ab4-45e9-a57e-056bdcdd33d8 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73" status: 200 len: 1367 microversion: 2.1 time: 0.149277 Jun 23 22:36:49.994832 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 56/111] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:49 2022] GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:50.237236 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-f6a6140d-3b43-440c-9400-5cf303d2f7b5 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:50.237840 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-f6a6140d-3b43-440c-9400-5cf303d2f7b5 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:50.243796 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f6a6140d-3b43-440c-9400-5cf303d2f7b5 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:50.244239 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f6a6140d-3b43-440c-9400-5cf303d2f7b5 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:50.244982 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f6a6140d-3b43-440c-9400-5cf303d2f7b5 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:50.245404 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f6a6140d-3b43-440c-9400-5cf303d2f7b5 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:50.376216 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-f6a6140d-3b43-440c-9400-5cf303d2f7b5 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:50.383739 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-f6a6140d-3b43-440c-9400-5cf303d2f7b5 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1322 microversion: 2.1 time: 0.150252 Jun 23 22:36:50.384305 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 56/112] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:50 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:50.416410 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-048222fc-282b-4a3a-8782-50ebb4770ad4 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:50.417022 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-048222fc-282b-4a3a-8782-50ebb4770ad4 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:50.423685 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-048222fc-282b-4a3a-8782-50ebb4770ad4 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:50.424131 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-048222fc-282b-4a3a-8782-50ebb4770ad4 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:50.424887 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-048222fc-282b-4a3a-8782-50ebb4770ad4 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:50.425330 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-048222fc-282b-4a3a-8782-50ebb4770ad4 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:50.554329 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-048222fc-282b-4a3a-8782-50ebb4770ad4 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c519b28b174ef385dd7e76b85cf504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becdae52e5c64b1ea2bb05833505b0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:50.562731 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-048222fc-282b-4a3a-8782-50ebb4770ad4 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] 10.222.0.43 "GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de" status: 200 len: 1314 microversion: 2.1 time: 0.149920 Jun 23 22:36:50.563169 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 57/113] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:50 2022] GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:51.011004 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-017ffd87-8a34-4a40-9591-1083b6aea92d tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:51.011643 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-017ffd87-8a34-4a40-9591-1083b6aea92d tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: cd22650e-6851-4f81-a8d4-e4c7ade26c73] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:51.018093 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-017ffd87-8a34-4a40-9591-1083b6aea92d tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:51.018531 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-017ffd87-8a34-4a40-9591-1083b6aea92d tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:51.019314 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-017ffd87-8a34-4a40-9591-1083b6aea92d tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:51.019740 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-017ffd87-8a34-4a40-9591-1083b6aea92d tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:51.152084 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-017ffd87-8a34-4a40-9591-1083b6aea92d tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:51.160388 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-017ffd87-8a34-4a40-9591-1083b6aea92d tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73" status: 200 len: 1367 microversion: 2.1 time: 0.153203 Jun 23 22:36:51.160946 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 57/114] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:51 2022] GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:51.404219 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f9eabbea-282b-423e-b52c-38ce142f1792 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:51.405206 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-f9eabbea-282b-423e-b52c-38ce142f1792 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:51.411942 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f9eabbea-282b-423e-b52c-38ce142f1792 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:51.412387 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f9eabbea-282b-423e-b52c-38ce142f1792 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:51.413141 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f9eabbea-282b-423e-b52c-38ce142f1792 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:51.413569 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f9eabbea-282b-423e-b52c-38ce142f1792 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:51.548767 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f9eabbea-282b-423e-b52c-38ce142f1792 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:51.556393 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f9eabbea-282b-423e-b52c-38ce142f1792 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1322 microversion: 2.1 time: 0.159021 Jun 23 22:36:51.556955 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 58/115] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:51 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:51.579097 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-06c24bee-fdcd-4374-8c0e-8d6a36c6da40 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:51.579714 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-06c24bee-fdcd-4374-8c0e-8d6a36c6da40 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:51.585830 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-06c24bee-fdcd-4374-8c0e-8d6a36c6da40 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:51.586272 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-06c24bee-fdcd-4374-8c0e-8d6a36c6da40 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:51.587231 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-06c24bee-fdcd-4374-8c0e-8d6a36c6da40 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:51.587781 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-06c24bee-fdcd-4374-8c0e-8d6a36c6da40 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:51.721508 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-06c24bee-fdcd-4374-8c0e-8d6a36c6da40 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c519b28b174ef385dd7e76b85cf504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becdae52e5c64b1ea2bb05833505b0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:51.728853 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-06c24bee-fdcd-4374-8c0e-8d6a36c6da40 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] 10.222.0.43 "GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de" status: 200 len: 1314 microversion: 2.1 time: 0.153588 Jun 23 22:36:51.729418 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 58/116] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:51 2022] GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:52.178734 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-10b14e4b-3bf4-419a-9481-ba3db991ea2c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:52.179313 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-10b14e4b-3bf4-419a-9481-ba3db991ea2c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: cd22650e-6851-4f81-a8d4-e4c7ade26c73] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:52.185797 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-10b14e4b-3bf4-419a-9481-ba3db991ea2c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:52.186258 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-10b14e4b-3bf4-419a-9481-ba3db991ea2c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:52.187024 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-10b14e4b-3bf4-419a-9481-ba3db991ea2c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:52.187454 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-10b14e4b-3bf4-419a-9481-ba3db991ea2c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:52.315001 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-10b14e4b-3bf4-419a-9481-ba3db991ea2c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:52.322540 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-10b14e4b-3bf4-419a-9481-ba3db991ea2c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73" status: 200 len: 1367 microversion: 2.1 time: 0.147539 Jun 23 22:36:52.323127 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 59/117] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:52 2022] GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:52.573472 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-a5a15390-3de2-464d-8e16-7c907dcb8851 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:52.574081 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-a5a15390-3de2-464d-8e16-7c907dcb8851 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:52.580757 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a5a15390-3de2-464d-8e16-7c907dcb8851 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:52.581362 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a5a15390-3de2-464d-8e16-7c907dcb8851 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:52.581926 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a5a15390-3de2-464d-8e16-7c907dcb8851 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:52.582352 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a5a15390-3de2-464d-8e16-7c907dcb8851 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:52.707592 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-a5a15390-3de2-464d-8e16-7c907dcb8851 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:52.714871 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-a5a15390-3de2-464d-8e16-7c907dcb8851 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1322 microversion: 2.1 time: 0.145304 Jun 23 22:36:52.715458 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 59/118] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:52 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:52.748439 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-39d37379-918e-4c2e-a189-9cbc8f682f36 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:52.749044 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-39d37379-918e-4c2e-a189-9cbc8f682f36 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:52.755230 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-39d37379-918e-4c2e-a189-9cbc8f682f36 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:52.755670 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-39d37379-918e-4c2e-a189-9cbc8f682f36 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:52.756415 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-39d37379-918e-4c2e-a189-9cbc8f682f36 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:52.756841 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-39d37379-918e-4c2e-a189-9cbc8f682f36 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:52.879457 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-39d37379-918e-4c2e-a189-9cbc8f682f36 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c519b28b174ef385dd7e76b85cf504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becdae52e5c64b1ea2bb05833505b0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:52.886800 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-39d37379-918e-4c2e-a189-9cbc8f682f36 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] 10.222.0.43 "GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de" status: 200 len: 1314 microversion: 2.1 time: 0.143872 Jun 23 22:36:52.888013 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 60/119] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:52 2022] GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:53.339434 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-7bff515a-5df3-4a71-8e87-e395eae226db tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:53.340040 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-7bff515a-5df3-4a71-8e87-e395eae226db tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: cd22650e-6851-4f81-a8d4-e4c7ade26c73] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:53.346130 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7bff515a-5df3-4a71-8e87-e395eae226db tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:53.346563 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7bff515a-5df3-4a71-8e87-e395eae226db tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:53.347348 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7bff515a-5df3-4a71-8e87-e395eae226db tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:53.347770 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7bff515a-5df3-4a71-8e87-e395eae226db tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:53.484702 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-7bff515a-5df3-4a71-8e87-e395eae226db tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:53.492272 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-7bff515a-5df3-4a71-8e87-e395eae226db tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73" status: 200 len: 1367 microversion: 2.1 time: 0.156760 Jun 23 22:36:53.492829 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 60/120] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:53 2022] GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:53.732516 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-cdbdec3b-54b3-4a06-8c72-6e956ae1dfd0 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:53.733149 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-cdbdec3b-54b3-4a06-8c72-6e956ae1dfd0 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:53.739376 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cdbdec3b-54b3-4a06-8c72-6e956ae1dfd0 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:53.739956 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cdbdec3b-54b3-4a06-8c72-6e956ae1dfd0 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:53.740782 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cdbdec3b-54b3-4a06-8c72-6e956ae1dfd0 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:53.741208 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cdbdec3b-54b3-4a06-8c72-6e956ae1dfd0 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:53.877834 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-cdbdec3b-54b3-4a06-8c72-6e956ae1dfd0 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:53.885461 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-cdbdec3b-54b3-4a06-8c72-6e956ae1dfd0 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1322 microversion: 2.1 time: 0.157533 Jun 23 22:36:53.886041 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 61/121] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:53 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:53.905594 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-2cbdeab0-82cd-4a41-8827-538560dfdf93 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:53.906319 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-2cbdeab0-82cd-4a41-8827-538560dfdf93 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:53.908698 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:36:53.914621 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2cbdeab0-82cd-4a41-8827-538560dfdf93 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:53.915108 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2cbdeab0-82cd-4a41-8827-538560dfdf93 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:53.915895 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2cbdeab0-82cd-4a41-8827-538560dfdf93 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:53.916325 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2cbdeab0-82cd-4a41-8827-538560dfdf93 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:54.069633 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-2cbdeab0-82cd-4a41-8827-538560dfdf93 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c519b28b174ef385dd7e76b85cf504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becdae52e5c64b1ea2bb05833505b0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:54.079435 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-2cbdeab0-82cd-4a41-8827-538560dfdf93 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] 10.222.0.43 "GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de" status: 200 len: 1314 microversion: 2.1 time: 0.178549 Jun 23 22:36:54.079647 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 61/122] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:53 2022] GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:36:54.509608 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-5b6a4c3e-ca81-491b-bf88-6a9c90a2f7ba tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:54.510792 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-5b6a4c3e-ca81-491b-bf88-6a9c90a2f7ba tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: cd22650e-6851-4f81-a8d4-e4c7ade26c73] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:54.518684 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5b6a4c3e-ca81-491b-bf88-6a9c90a2f7ba tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:54.519259 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5b6a4c3e-ca81-491b-bf88-6a9c90a2f7ba tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:54.520102 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5b6a4c3e-ca81-491b-bf88-6a9c90a2f7ba tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:54.520536 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5b6a4c3e-ca81-491b-bf88-6a9c90a2f7ba tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:54.672821 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-5b6a4c3e-ca81-491b-bf88-6a9c90a2f7ba tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:54.680523 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-5b6a4c3e-ca81-491b-bf88-6a9c90a2f7ba tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73" status: 200 len: 1367 microversion: 2.1 time: 0.174825 Jun 23 22:36:54.682090 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 62/123] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:54 2022] GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:54.901951 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-1e97c3b7-8d62-4199-806e-0ff9cb04f6bd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:54.902819 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-1e97c3b7-8d62-4199-806e-0ff9cb04f6bd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:54.909763 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1e97c3b7-8d62-4199-806e-0ff9cb04f6bd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:54.910908 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1e97c3b7-8d62-4199-806e-0ff9cb04f6bd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:54.911876 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1e97c3b7-8d62-4199-806e-0ff9cb04f6bd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:54.912748 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1e97c3b7-8d62-4199-806e-0ff9cb04f6bd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:55.097712 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b41d8fdb-6a08-4e2d-ad73-a414cdce2999 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:55.099246 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-b41d8fdb-6a08-4e2d-ad73-a414cdce2999 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:55.113494 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b41d8fdb-6a08-4e2d-ad73-a414cdce2999 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:55.113898 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-1e97c3b7-8d62-4199-806e-0ff9cb04f6bd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:55.114090 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b41d8fdb-6a08-4e2d-ad73-a414cdce2999 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:55.115344 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b41d8fdb-6a08-4e2d-ad73-a414cdce2999 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:55.115873 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b41d8fdb-6a08-4e2d-ad73-a414cdce2999 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:55.132823 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-1e97c3b7-8d62-4199-806e-0ff9cb04f6bd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1322 microversion: 2.1 time: 0.234819 Jun 23 22:36:55.133431 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 62/124] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:54 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:55.259133 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b41d8fdb-6a08-4e2d-ad73-a414cdce2999 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c519b28b174ef385dd7e76b85cf504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becdae52e5c64b1ea2bb05833505b0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:55.267369 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-b41d8fdb-6a08-4e2d-ad73-a414cdce2999 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] 10.222.0.43 "GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de" status: 200 len: 1500 microversion: 2.1 time: 0.174357 Jun 23 22:36:55.267960 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 63/125] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:55 2022] GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de => generated 1500 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:55.699324 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-bde1c9cb-75a1-454a-ab69-84afaa01253c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:55.699847 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-bde1c9cb-75a1-454a-ab69-84afaa01253c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: cd22650e-6851-4f81-a8d4-e4c7ade26c73] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:55.707980 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-bde1c9cb-75a1-454a-ab69-84afaa01253c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:55.708428 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-bde1c9cb-75a1-454a-ab69-84afaa01253c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:55.709192 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-bde1c9cb-75a1-454a-ab69-84afaa01253c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:55.709640 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-bde1c9cb-75a1-454a-ab69-84afaa01253c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:55.839647 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-bde1c9cb-75a1-454a-ab69-84afaa01253c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:55.847693 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-bde1c9cb-75a1-454a-ab69-84afaa01253c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73" status: 200 len: 1557 microversion: 2.1 time: 0.152395 Jun 23 22:36:55.848262 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 63/126] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:55 2022] GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:55.865072 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-6d037c0d-6b87-4877-a694-6bfe91f2e773 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:55.865563 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-6d037c0d-6b87-4877-a694-6bfe91f2e773 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: cd22650e-6851-4f81-a8d4-e4c7ade26c73] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:55.871537 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6d037c0d-6b87-4877-a694-6bfe91f2e773 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:55.872069 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6d037c0d-6b87-4877-a694-6bfe91f2e773 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:55.873259 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6d037c0d-6b87-4877-a694-6bfe91f2e773 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:55.873695 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6d037c0d-6b87-4877-a694-6bfe91f2e773 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:55.954490 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-6d037c0d-6b87-4877-a694-6bfe91f2e773 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093193 Jun 23 22:36:55.955172 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 64/127] 10.222.0.43 () {58 vars in 1274 bytes} [Thu Jun 23 22:36:55 2022] GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:36:56.151590 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-56480408-5f0b-4cd7-893d-fd0ddebe9660 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:56.152193 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-56480408-5f0b-4cd7-893d-fd0ddebe9660 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:56.160045 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-56480408-5f0b-4cd7-893d-fd0ddebe9660 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:56.160695 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-56480408-5f0b-4cd7-893d-fd0ddebe9660 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:56.161750 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-56480408-5f0b-4cd7-893d-fd0ddebe9660 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:56.163522 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-56480408-5f0b-4cd7-893d-fd0ddebe9660 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:56.407893 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-56480408-5f0b-4cd7-893d-fd0ddebe9660 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:56.421331 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-56480408-5f0b-4cd7-893d-fd0ddebe9660 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1322 microversion: 2.1 time: 0.275134 Jun 23 22:36:56.422435 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 64/128] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:56 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:56.726383 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d7d2c22e-361c-48ac-8f07-d367f3b7dfe4 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "531700d7-1890-4b9a-8bd8-a96e8b03da63"}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:36:56.727686 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-d7d2c22e-361c-48ac-8f07-d367f3b7dfe4 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:56.734780 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d7d2c22e-361c-48ac-8f07-d367f3b7dfe4 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:56.735462 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d7d2c22e-361c-48ac-8f07-d367f3b7dfe4 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:56.736859 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d7d2c22e-361c-48ac-8f07-d367f3b7dfe4 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:56.737531 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d7d2c22e-361c-48ac-8f07-d367f3b7dfe4 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:57.370946 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [req-d5a89a28-cdf8-447a-9cd5-6c6729338b5d req-8ddfbc6c-1e1a-4663-8c22-de2e8afcb33c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd22650e-6851-4f81-a8d4-e4c7ade26c73", "tag": "e97c4f2f-223c-4f40-b688-f46dae13754f"}]} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:36:57.381884 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-d5a89a28-cdf8-447a-9cd5-6c6729338b5d req-8ddfbc6c-1e1a-4663-8c22-de2e8afcb33c service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:57.382400 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-d5a89a28-cdf8-447a-9cd5-6c6729338b5d req-8ddfbc6c-1e1a-4663-8c22-de2e8afcb33c service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:57.396471 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.compute.server_external_events [req-d5a89a28-cdf8-447a-9cd5-6c6729338b5d req-8ddfbc6c-1e1a-4663-8c22-de2e8afcb33c service nova] Creating event network-changed:e97c4f2f-223c-4f40-b688-f46dae13754f for instance cd22650e-6851-4f81-a8d4-e4c7ade26c73 on hv-cinder-84617 Jun 23 22:36:57.401752 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [req-d5a89a28-cdf8-447a-9cd5-6c6729338b5d req-8ddfbc6c-1e1a-4663-8c22-de2e8afcb33c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034580 Jun 23 22:36:57.402735 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 65/129] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:36:57.455272 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-7d44cd15-95dc-4be0-b6bf-78b39a059f7b tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:57.456211 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-7d44cd15-95dc-4be0-b6bf-78b39a059f7b tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:57.467053 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7d44cd15-95dc-4be0-b6bf-78b39a059f7b tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:57.467720 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7d44cd15-95dc-4be0-b6bf-78b39a059f7b tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:57.468745 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7d44cd15-95dc-4be0-b6bf-78b39a059f7b tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:57.469177 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7d44cd15-95dc-4be0-b6bf-78b39a059f7b tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:57.613799 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-7d44cd15-95dc-4be0-b6bf-78b39a059f7b tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:57.623369 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-7d44cd15-95dc-4be0-b6bf-78b39a059f7b tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1322 microversion: 2.1 time: 0.177014 Jun 23 22:36:57.624211 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 66/130] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:57 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:36:58.642215 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-7c4c90a5-49d6-43af-9e72-f393ffd208bf tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:58.642852 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-7c4c90a5-49d6-43af-9e72-f393ffd208bf tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:58.649078 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7c4c90a5-49d6-43af-9e72-f393ffd208bf tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:58.649522 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7c4c90a5-49d6-43af-9e72-f393ffd208bf tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:58.650285 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7c4c90a5-49d6-43af-9e72-f393ffd208bf tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:58.650713 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7c4c90a5-49d6-43af-9e72-f393ffd208bf tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:58.852980 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-7c4c90a5-49d6-43af-9e72-f393ffd208bf tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:58.861310 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-7c4c90a5-49d6-43af-9e72-f393ffd208bf tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1517 microversion: 2.1 time: 0.223083 Jun 23 22:36:58.861803 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 67/131] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:58 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1517 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:36:58.878684 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-408fc8f6-3d61-42ca-b075-be0ef354a2ac tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:36:58.879709 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-408fc8f6-3d61-42ca-b075-be0ef354a2ac tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:58.885495 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-408fc8f6-3d61-42ca-b075-be0ef354a2ac tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:58.885940 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-408fc8f6-3d61-42ca-b075-be0ef354a2ac tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:58.886701 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-408fc8f6-3d61-42ca-b075-be0ef354a2ac tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:58.887169 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-408fc8f6-3d61-42ca-b075-be0ef354a2ac tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:58.951118 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.objects.instance [None req-408fc8f6-3d61-42ca-b075-be0ef354a2ac tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lazy-loading 'flavor' on Instance uuid eda9f458-d54a-46b6-a86a-884bc9d95a64 {{(pid=124357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:36:59.069467 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-408fc8f6-3d61-42ca-b075-be0ef354a2ac tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "POST /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64/action" status: 200 len: 32 microversion: 2.1 time: 0.194611 Jun 23 22:36:59.070059 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 68/132] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Jun 23 22:36:58 2022] POST /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64/action => generated 32 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 23 22:36:59.079412 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-d906e1d4-b3e4-4e05-bdfa-e2e703284dc7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:59.080148 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-d906e1d4-b3e4-4e05-bdfa-e2e703284dc7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:36:59.086379 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d906e1d4-b3e4-4e05-bdfa-e2e703284dc7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:59.086827 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d906e1d4-b3e4-4e05-bdfa-e2e703284dc7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:59.087626 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d906e1d4-b3e4-4e05-bdfa-e2e703284dc7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:59.088056 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d906e1d4-b3e4-4e05-bdfa-e2e703284dc7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:59.225688 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-d906e1d4-b3e4-4e05-bdfa-e2e703284dc7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:36:59.228138 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:36:59.235656 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-d906e1d4-b3e4-4e05-bdfa-e2e703284dc7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1523 microversion: 2.1 time: 0.160359 Jun 23 22:36:59.236225 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 69/133] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:36:59 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:37:00.253346 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-2b04d2c6-5c3b-4da3-a295-8eb53cef9806 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:00.253974 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-2b04d2c6-5c3b-4da3-a295-8eb53cef9806 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:00.261642 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2b04d2c6-5c3b-4da3-a295-8eb53cef9806 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:00.262235 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2b04d2c6-5c3b-4da3-a295-8eb53cef9806 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:00.263856 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2b04d2c6-5c3b-4da3-a295-8eb53cef9806 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:00.264290 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2b04d2c6-5c3b-4da3-a295-8eb53cef9806 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:00.396572 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-2b04d2c6-5c3b-4da3-a295-8eb53cef9806 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:00.404537 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-2b04d2c6-5c3b-4da3-a295-8eb53cef9806 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1523 microversion: 2.1 time: 0.155740 Jun 23 22:37:00.405099 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 70/134] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:00 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:37:01.422502 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-76a1409f-b037-4f37-a1cb-15474459117a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:01.423246 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-76a1409f-b037-4f37-a1cb-15474459117a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:01.429664 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-76a1409f-b037-4f37-a1cb-15474459117a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:01.430179 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-76a1409f-b037-4f37-a1cb-15474459117a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:01.430969 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-76a1409f-b037-4f37-a1cb-15474459117a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:01.431404 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-76a1409f-b037-4f37-a1cb-15474459117a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:01.557819 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-76a1409f-b037-4f37-a1cb-15474459117a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:01.565623 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-76a1409f-b037-4f37-a1cb-15474459117a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1523 microversion: 2.1 time: 0.148085 Jun 23 22:37:01.566195 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 71/135] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:01 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:37:02.583567 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-03f22c20-c6d5-4765-890b-67fb4b697107 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:02.584347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-03f22c20-c6d5-4765-890b-67fb4b697107 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:02.592159 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-03f22c20-c6d5-4765-890b-67fb4b697107 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:02.592628 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-03f22c20-c6d5-4765-890b-67fb4b697107 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:02.593373 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-03f22c20-c6d5-4765-890b-67fb4b697107 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:02.593808 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-03f22c20-c6d5-4765-890b-67fb4b697107 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:02.822713 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:37:02.845148 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d7d2c22e-361c-48ac-8f07-d367f3b7dfe4 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] 10.222.0.43 "POST /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.122746 Jun 23 22:37:02.846031 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 65/136] 10.222.0.43 () {60 vars in 1322 bytes} [Thu Jun 23 22:36:56 2022] POST /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de/os-volume_attachments => generated 194 bytes in 6124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:37:03.014914 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-03f22c20-c6d5-4765-890b-67fb4b697107 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:03.022720 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-03f22c20-c6d5-4765-890b-67fb4b697107 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1523 microversion: 2.1 time: 0.443526 Jun 23 22:37:03.023382 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 72/137] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:02 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1523 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:04.040854 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-5b522394-acd9-4ae1-a8f4-35101d412d1e tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:04.041629 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-5b522394-acd9-4ae1-a8f4-35101d412d1e tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:04.053520 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5b522394-acd9-4ae1-a8f4-35101d412d1e tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:04.054024 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5b522394-acd9-4ae1-a8f4-35101d412d1e tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:04.060619 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5b522394-acd9-4ae1-a8f4-35101d412d1e tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:04.063000 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5b522394-acd9-4ae1-a8f4-35101d412d1e tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:04.562103 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-5b522394-acd9-4ae1-a8f4-35101d412d1e tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:04.573887 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-5b522394-acd9-4ae1-a8f4-35101d412d1e tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1523 microversion: 2.1 time: 0.537072 Jun 23 22:37:04.575802 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 66/138] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:04 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1523 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:05.593370 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-fd3018af-0253-45b6-b3c3-4eb3e3e032f3 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:05.593990 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-fd3018af-0253-45b6-b3c3-4eb3e3e032f3 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:05.600474 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fd3018af-0253-45b6-b3c3-4eb3e3e032f3 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:05.601166 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fd3018af-0253-45b6-b3c3-4eb3e3e032f3 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:05.602247 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fd3018af-0253-45b6-b3c3-4eb3e3e032f3 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:05.602832 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fd3018af-0253-45b6-b3c3-4eb3e3e032f3 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:05.869932 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-fd3018af-0253-45b6-b3c3-4eb3e3e032f3 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:05.883200 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-fd3018af-0253-45b6-b3c3-4eb3e3e032f3 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1523 microversion: 2.1 time: 0.294405 Jun 23 22:37:05.894329 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 73/139] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:05 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1523 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:06.902433 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-23d14ada-7a2c-466d-8f9c-515d89ba1f9c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:06.903483 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-23d14ada-7a2c-466d-8f9c-515d89ba1f9c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:06.918456 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-23d14ada-7a2c-466d-8f9c-515d89ba1f9c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:06.919351 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-23d14ada-7a2c-466d-8f9c-515d89ba1f9c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:06.921406 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-23d14ada-7a2c-466d-8f9c-515d89ba1f9c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:06.922079 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-23d14ada-7a2c-466d-8f9c-515d89ba1f9c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:07.180467 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-23d14ada-7a2c-466d-8f9c-515d89ba1f9c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:07.193930 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-23d14ada-7a2c-466d-8f9c-515d89ba1f9c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1523 microversion: 2.1 time: 0.295685 Jun 23 22:37:07.194908 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 67/140] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:06 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1523 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:08.222446 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-43c57415-2ca4-4025-87cf-952284781878 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:08.225342 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-43c57415-2ca4-4025-87cf-952284781878 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:08.235864 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-43c57415-2ca4-4025-87cf-952284781878 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:08.236597 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-43c57415-2ca4-4025-87cf-952284781878 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:08.240132 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-43c57415-2ca4-4025-87cf-952284781878 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:08.240914 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-43c57415-2ca4-4025-87cf-952284781878 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:08.551280 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-43c57415-2ca4-4025-87cf-952284781878 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:08.560004 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-43c57415-2ca4-4025-87cf-952284781878 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1523 microversion: 2.1 time: 0.342657 Jun 23 22:37:08.561367 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 74/141] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:08 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1523 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:09.578849 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-ad848d3e-342d-46d8-8f0d-b3cbb6089185 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:09.579411 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-ad848d3e-342d-46d8-8f0d-b3cbb6089185 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:09.586695 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ad848d3e-342d-46d8-8f0d-b3cbb6089185 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:09.587185 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ad848d3e-342d-46d8-8f0d-b3cbb6089185 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:09.587962 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ad848d3e-342d-46d8-8f0d-b3cbb6089185 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:09.588385 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ad848d3e-342d-46d8-8f0d-b3cbb6089185 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:09.741906 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ad848d3e-342d-46d8-8f0d-b3cbb6089185 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:09.749913 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-ad848d3e-342d-46d8-8f0d-b3cbb6089185 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1523 microversion: 2.1 time: 0.175861 Jun 23 22:37:09.750488 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 68/142] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:09 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:10.639393 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-527c2306-a799-461d-af69-39c6b1c58693 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-170154478", "imageRef": "ac7d441e-2ac8-49ad-9dc5-3c55bd4b4f8b", "flavorRef": "452", "networks": [{"uuid": "37e85836-e932-474e-813c-5279946996b9"}]}} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:37:10.692787 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.network.neutron [None req-527c2306-a799-461d-af69-39c6b1c58693 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] validate_networks() for [('37e85836-e932-474e-813c-5279946996b9', None, None, None, None, None)] {{(pid=124357) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:37:10.768374 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-6171f86e-e472-4520-a9c0-e1579a510fac tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:10.768988 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-6171f86e-e472-4520-a9c0-e1579a510fac tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:10.782949 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=58 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:37:10.789376 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6171f86e-e472-4520-a9c0-e1579a510fac tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:10.789866 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6171f86e-e472-4520-a9c0-e1579a510fac tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:10.790659 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6171f86e-e472-4520-a9c0-e1579a510fac tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:10.791293 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6171f86e-e472-4520-a9c0-e1579a510fac tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:11.088732 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-6171f86e-e472-4520-a9c0-e1579a510fac tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:11.096575 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-6171f86e-e472-4520-a9c0-e1579a510fac tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1523 microversion: 2.1 time: 0.332018 Jun 23 22:37:11.097153 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 69/143] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:10 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1523 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:37:11.216634 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-527c2306-a799-461d-af69-39c6b1c58693 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Flavor limits 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:37:11.217057 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-527c2306-a799-461d-af69-39c6b1c58693 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Image limits 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:37:11.217586 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-527c2306-a799-461d-af69-39c6b1c58693 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Flavor pref 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:37:11.217942 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-527c2306-a799-461d-af69-39c6b1c58693 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Image pref 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:37:11.218364 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-527c2306-a799-461d-af69-39c6b1c58693 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:37:11.228330 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-527c2306-a799-461d-af69-39c6b1c58693 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:11.228779 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-527c2306-a799-461d-af69-39c6b1c58693 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:11.229488 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-527c2306-a799-461d-af69-39c6b1c58693 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:11.229945 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-527c2306-a799-461d-af69-39c6b1c58693 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:11.248978 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-527c2306-a799-461d-af69-39c6b1c58693 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Getting quotas for project e4fb6c541ee04ebea81001c24c67d779. Resources: {'instances', 'cores', 'ram'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:37:11.252778 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-527c2306-a799-461d-af69-39c6b1c58693 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Getting quotas for user bbe630f5c7c243588c5bd33023775d69 and project e4fb6c541ee04ebea81001c24c67d779. Resources: {'instances', 'cores', 'ram'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:37:11.264977 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-527c2306-a799-461d-af69-39c6b1c58693 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Going to run 1 instances... {{(pid=124357) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:37:11.267313 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-527c2306-a799-461d-af69-39c6b1c58693 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: b98e3e93-9c53-4ff5-8a14-b0cf0a030c72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ac7d441e-2ac8-49ad-9dc5-3c55bd4b4f8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:37:11.316321 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-527c2306-a799-461d-af69-39c6b1c58693 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.681444 Jun 23 22:37:11.317622 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 75/144] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Jun 23 22:37:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 22:37:11.329674 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d9f305d5-4695-4993-b742-d523ee88fcb2 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:11.330194 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-d9f305d5-4695-4993-b742-d523ee88fcb2 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: b98e3e93-9c53-4ff5-8a14-b0cf0a030c72] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:11.388031 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d9f305d5-4695-4993-b742-d523ee88fcb2 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:11.395110 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d9f305d5-4695-4993-b742-d523ee88fcb2 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72" status: 200 len: 1213 microversion: 2.1 time: 0.071053 Jun 23 22:37:11.395895 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 70/145] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:11 2022] GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72 => generated 1213 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:11.716966 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-e0bd3586-e98b-4a13-a54d-7eb9406ef903 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:11.717537 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-e0bd3586-e98b-4a13-a54d-7eb9406ef903 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:11.723879 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-e0bd3586-e98b-4a13-a54d-7eb9406ef903 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:11.724336 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-e0bd3586-e98b-4a13-a54d-7eb9406ef903 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:11.725609 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-e0bd3586-e98b-4a13-a54d-7eb9406ef903 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:11.726047 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-e0bd3586-e98b-4a13-a54d-7eb9406ef903 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:11.755454 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-e0bd3586-e98b-4a13-a54d-7eb9406ef903 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] Going to try to terminate instance {{(pid=124357) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:37:11.880042 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-e0bd3586-e98b-4a13-a54d-7eb9406ef903 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de" status: 204 len: 0 microversion: 2.1 time: 0.166581 Jun 23 22:37:11.881067 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 76/146] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 23 22:37:11 2022] DELETE /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 22:37:11.892248 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e0c89261-b082-4f47-8638-183dd5824cc0 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:11.892962 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e0c89261-b082-4f47-8638-183dd5824cc0 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:11.905948 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e0c89261-b082-4f47-8638-183dd5824cc0 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:11.906381 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e0c89261-b082-4f47-8638-183dd5824cc0 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:11.907528 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e0c89261-b082-4f47-8638-183dd5824cc0 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:11.908282 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e0c89261-b082-4f47-8638-183dd5824cc0 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:12.118219 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-196f1b09-0ca6-48ed-994b-21f2c7e68659 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:12.118219 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-196f1b09-0ca6-48ed-994b-21f2c7e68659 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:12.121270 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e0c89261-b082-4f47-8638-183dd5824cc0 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c519b28b174ef385dd7e76b85cf504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becdae52e5c64b1ea2bb05833505b0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:12.124019 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-196f1b09-0ca6-48ed-994b-21f2c7e68659 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:12.124646 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-196f1b09-0ca6-48ed-994b-21f2c7e68659 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:12.125607 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-196f1b09-0ca6-48ed-994b-21f2c7e68659 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:12.126180 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-196f1b09-0ca6-48ed-994b-21f2c7e68659 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:12.150054 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e0c89261-b082-4f47-8638-183dd5824cc0 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] 10.222.0.43 "GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de" status: 200 len: 1552 microversion: 2.1 time: 0.264061 Jun 23 22:37:12.150646 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 71/147] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:11 2022] GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de => generated 1552 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:12.294714 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-196f1b09-0ca6-48ed-994b-21f2c7e68659 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:12.302186 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-196f1b09-0ca6-48ed-994b-21f2c7e68659 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1523 microversion: 2.1 time: 0.191766 Jun 23 22:37:12.302764 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 77/148] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:12 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1523 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:37:12.413542 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d626c48d-99c1-46d7-afb4-ef2f4d78482b tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:12.414406 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-d626c48d-99c1-46d7-afb4-ef2f4d78482b tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: b98e3e93-9c53-4ff5-8a14-b0cf0a030c72] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:12.422783 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d626c48d-99c1-46d7-afb4-ef2f4d78482b tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:12.423372 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d626c48d-99c1-46d7-afb4-ef2f4d78482b tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:12.424129 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d626c48d-99c1-46d7-afb4-ef2f4d78482b tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:12.424554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d626c48d-99c1-46d7-afb4-ef2f4d78482b tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:12.494982 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d626c48d-99c1-46d7-afb4-ef2f4d78482b tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:12.503878 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d626c48d-99c1-46d7-afb4-ef2f4d78482b tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72" status: 200 len: 1209 microversion: 2.1 time: 0.094471 Jun 23 22:37:12.504458 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 72/149] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:12 2022] GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72 => generated 1209 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:13.168157 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-9ea76907-2761-4e57-8afe-592b08c91688 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:13.168808 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-9ea76907-2761-4e57-8afe-592b08c91688 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:13.174829 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9ea76907-2761-4e57-8afe-592b08c91688 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:13.175324 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9ea76907-2761-4e57-8afe-592b08c91688 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:13.176082 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9ea76907-2761-4e57-8afe-592b08c91688 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:13.176505 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9ea76907-2761-4e57-8afe-592b08c91688 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:13.315867 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-9ea76907-2761-4e57-8afe-592b08c91688 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c519b28b174ef385dd7e76b85cf504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becdae52e5c64b1ea2bb05833505b0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:13.319333 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-52fe48b7-1b88-4e11-b922-a44f2fa8ba57 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:13.320437 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-52fe48b7-1b88-4e11-b922-a44f2fa8ba57 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:13.327656 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-9ea76907-2761-4e57-8afe-592b08c91688 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] 10.222.0.43 "GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de" status: 200 len: 1552 microversion: 2.1 time: 0.163106 Jun 23 22:37:13.328194 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-52fe48b7-1b88-4e11-b922-a44f2fa8ba57 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:13.328487 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 78/150] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:13 2022] GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de => generated 1552 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:13.339081 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-52fe48b7-1b88-4e11-b922-a44f2fa8ba57 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:13.339081 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-52fe48b7-1b88-4e11-b922-a44f2fa8ba57 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:13.339081 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-52fe48b7-1b88-4e11-b922-a44f2fa8ba57 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:13.492184 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-52fe48b7-1b88-4e11-b922-a44f2fa8ba57 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:13.500299 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-52fe48b7-1b88-4e11-b922-a44f2fa8ba57 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1523 microversion: 2.1 time: 0.184725 Jun 23 22:37:13.500873 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 73/151] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:13 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:37:13.523131 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-ce4e48bd-c0e3-4d6f-9e1f-4b0d84c96945 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:13.523753 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-ce4e48bd-c0e3-4d6f-9e1f-4b0d84c96945 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: b98e3e93-9c53-4ff5-8a14-b0cf0a030c72] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:13.531426 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ce4e48bd-c0e3-4d6f-9e1f-4b0d84c96945 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:13.531904 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ce4e48bd-c0e3-4d6f-9e1f-4b0d84c96945 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:13.532701 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ce4e48bd-c0e3-4d6f-9e1f-4b0d84c96945 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:13.533160 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ce4e48bd-c0e3-4d6f-9e1f-4b0d84c96945 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:13.596655 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-ce4e48bd-c0e3-4d6f-9e1f-4b0d84c96945 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:13.604694 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-ce4e48bd-c0e3-4d6f-9e1f-4b0d84c96945 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72" status: 200 len: 1209 microversion: 2.1 time: 0.085517 Jun 23 22:37:13.605251 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 79/152] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:13 2022] GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72 => generated 1209 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:14.346822 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-93cc64e6-9d16-4c53-808b-7e75baa2e984 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:14.347490 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-93cc64e6-9d16-4c53-808b-7e75baa2e984 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:14.354513 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-93cc64e6-9d16-4c53-808b-7e75baa2e984 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:14.354985 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-93cc64e6-9d16-4c53-808b-7e75baa2e984 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:14.355808 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-93cc64e6-9d16-4c53-808b-7e75baa2e984 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:14.356301 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-93cc64e6-9d16-4c53-808b-7e75baa2e984 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:14.494331 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-93cc64e6-9d16-4c53-808b-7e75baa2e984 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c519b28b174ef385dd7e76b85cf504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becdae52e5c64b1ea2bb05833505b0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:14.505363 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-93cc64e6-9d16-4c53-808b-7e75baa2e984 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] 10.222.0.43 "GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de" status: 200 len: 1552 microversion: 2.1 time: 0.162432 Jun 23 22:37:14.506433 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 74/153] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:14 2022] GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de => generated 1552 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:14.519042 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-4ba5c39c-2ee2-4889-8f6b-ebfdd2b49700 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:14.519678 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-4ba5c39c-2ee2-4889-8f6b-ebfdd2b49700 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:14.525619 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-4ba5c39c-2ee2-4889-8f6b-ebfdd2b49700 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:14.526056 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-4ba5c39c-2ee2-4889-8f6b-ebfdd2b49700 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:14.526799 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-4ba5c39c-2ee2-4889-8f6b-ebfdd2b49700 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:14.527250 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-4ba5c39c-2ee2-4889-8f6b-ebfdd2b49700 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:14.623178 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-53dfcf22-0cef-4093-8ae6-a51dbc66daf1 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:14.623797 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-53dfcf22-0cef-4093-8ae6-a51dbc66daf1 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: b98e3e93-9c53-4ff5-8a14-b0cf0a030c72] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:14.630627 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-53dfcf22-0cef-4093-8ae6-a51dbc66daf1 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:14.631361 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-53dfcf22-0cef-4093-8ae6-a51dbc66daf1 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:14.632321 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-53dfcf22-0cef-4093-8ae6-a51dbc66daf1 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:14.632910 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-53dfcf22-0cef-4093-8ae6-a51dbc66daf1 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:14.685300 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-4ba5c39c-2ee2-4889-8f6b-ebfdd2b49700 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:14.695934 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-4ba5c39c-2ee2-4889-8f6b-ebfdd2b49700 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1523 microversion: 2.1 time: 0.181933 Jun 23 22:37:14.696688 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 80/154] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:14 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:14.708566 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-53dfcf22-0cef-4093-8ae6-a51dbc66daf1 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:14.718025 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-53dfcf22-0cef-4093-8ae6-a51dbc66daf1 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72" status: 200 len: 1273 microversion: 2.1 time: 0.100235 Jun 23 22:37:14.718614 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 75/155] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:14 2022] GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72 => generated 1273 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:37:15.524272 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-2aac6e84-b11f-47c6-bfa3-ac4c2f013378 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:15.524887 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-2aac6e84-b11f-47c6-bfa3-ac4c2f013378 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:15.531511 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2aac6e84-b11f-47c6-bfa3-ac4c2f013378 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:15.531956 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2aac6e84-b11f-47c6-bfa3-ac4c2f013378 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:15.532717 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2aac6e84-b11f-47c6-bfa3-ac4c2f013378 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:15.533148 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2aac6e84-b11f-47c6-bfa3-ac4c2f013378 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:15.658305 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-2aac6e84-b11f-47c6-bfa3-ac4c2f013378 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c519b28b174ef385dd7e76b85cf504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becdae52e5c64b1ea2bb05833505b0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:15.666460 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-2aac6e84-b11f-47c6-bfa3-ac4c2f013378 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] 10.222.0.43 "GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de" status: 200 len: 1552 microversion: 2.1 time: 0.146054 Jun 23 22:37:15.667040 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 81/156] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:15 2022] GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de => generated 1552 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:15.713288 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d2e6e768-591a-4815-a47a-0efa47eba3b5 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:15.713892 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-d2e6e768-591a-4815-a47a-0efa47eba3b5 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:15.721161 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d2e6e768-591a-4815-a47a-0efa47eba3b5 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:15.721611 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d2e6e768-591a-4815-a47a-0efa47eba3b5 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:15.722371 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d2e6e768-591a-4815-a47a-0efa47eba3b5 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:15.722804 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d2e6e768-591a-4815-a47a-0efa47eba3b5 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:15.736431 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-3705298c-518d-4b22-b14b-1647043d4a2f tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:15.737035 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-3705298c-518d-4b22-b14b-1647043d4a2f tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: b98e3e93-9c53-4ff5-8a14-b0cf0a030c72] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:15.742907 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3705298c-518d-4b22-b14b-1647043d4a2f tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:15.743378 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3705298c-518d-4b22-b14b-1647043d4a2f tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:15.744124 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3705298c-518d-4b22-b14b-1647043d4a2f tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:15.744552 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3705298c-518d-4b22-b14b-1647043d4a2f tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:15.819549 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-3705298c-518d-4b22-b14b-1647043d4a2f tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:15.827890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-3705298c-518d-4b22-b14b-1647043d4a2f tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72" status: 200 len: 1283 microversion: 2.1 time: 0.096525 Jun 23 22:37:15.828466 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 82/157] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:15 2022] GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72 => generated 1283 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:37:15.881261 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d2e6e768-591a-4815-a47a-0efa47eba3b5 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:15.889335 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d2e6e768-591a-4815-a47a-0efa47eba3b5 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1523 microversion: 2.1 time: 0.179829 Jun 23 22:37:15.889894 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 76/158] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:15 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:16.683750 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-b7894fd8-f762-477c-ad1a-8ee2c25fc8fc tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:16.685178 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-b7894fd8-f762-477c-ad1a-8ee2c25fc8fc tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:16.691129 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-b7894fd8-f762-477c-ad1a-8ee2c25fc8fc tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:16.691567 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-b7894fd8-f762-477c-ad1a-8ee2c25fc8fc tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:16.692304 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-b7894fd8-f762-477c-ad1a-8ee2c25fc8fc tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:16.692728 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-b7894fd8-f762-477c-ad1a-8ee2c25fc8fc tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:16.818527 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-b7894fd8-f762-477c-ad1a-8ee2c25fc8fc tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c519b28b174ef385dd7e76b85cf504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becdae52e5c64b1ea2bb05833505b0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:16.827629 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-b7894fd8-f762-477c-ad1a-8ee2c25fc8fc tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] 10.222.0.43 "GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de" status: 200 len: 1552 microversion: 2.1 time: 0.147705 Jun 23 22:37:16.828281 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 83/159] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:16 2022] GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de => generated 1552 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:16.844635 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-cf61a5d6-d5e2-430f-93b3-e5d153c7b831 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:16.845236 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-cf61a5d6-d5e2-430f-93b3-e5d153c7b831 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: b98e3e93-9c53-4ff5-8a14-b0cf0a030c72] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:16.851906 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cf61a5d6-d5e2-430f-93b3-e5d153c7b831 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:16.852372 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cf61a5d6-d5e2-430f-93b3-e5d153c7b831 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:16.853131 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cf61a5d6-d5e2-430f-93b3-e5d153c7b831 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:16.853557 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cf61a5d6-d5e2-430f-93b3-e5d153c7b831 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:16.905993 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-c6cdb183-4766-4b04-ab8a-82eb5a0539c6 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:16.906984 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-c6cdb183-4766-4b04-ab8a-82eb5a0539c6 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:16.915697 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c6cdb183-4766-4b04-ab8a-82eb5a0539c6 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:16.916125 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c6cdb183-4766-4b04-ab8a-82eb5a0539c6 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:16.916583 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-cf61a5d6-d5e2-430f-93b3-e5d153c7b831 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:16.917048 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c6cdb183-4766-4b04-ab8a-82eb5a0539c6 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:16.917780 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c6cdb183-4766-4b04-ab8a-82eb5a0539c6 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:16.925096 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-cf61a5d6-d5e2-430f-93b3-e5d153c7b831 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72" status: 200 len: 1283 microversion: 2.1 time: 0.084132 Jun 23 22:37:16.925665 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 77/160] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:16 2022] GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72 => generated 1283 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:17.048943 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-c6cdb183-4766-4b04-ab8a-82eb5a0539c6 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:17.056285 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-c6cdb183-4766-4b04-ab8a-82eb5a0539c6 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1523 microversion: 2.1 time: 0.154153 Jun 23 22:37:17.056845 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 84/161] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:16 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:37:17.845055 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-1810e9d0-5949-42b6-9ae9-9775f9049cd3 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:17.845594 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-1810e9d0-5949-42b6-9ae9-9775f9049cd3 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:17.852411 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1810e9d0-5949-42b6-9ae9-9775f9049cd3 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:17.852855 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1810e9d0-5949-42b6-9ae9-9775f9049cd3 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:17.853616 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1810e9d0-5949-42b6-9ae9-9775f9049cd3 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:17.854038 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1810e9d0-5949-42b6-9ae9-9775f9049cd3 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:17.941933 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-d46cb723-0887-4ecf-83c6-f639d9b79681 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:17.942646 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-d46cb723-0887-4ecf-83c6-f639d9b79681 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: b98e3e93-9c53-4ff5-8a14-b0cf0a030c72] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:17.949424 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d46cb723-0887-4ecf-83c6-f639d9b79681 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:17.950684 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d46cb723-0887-4ecf-83c6-f639d9b79681 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:17.951551 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d46cb723-0887-4ecf-83c6-f639d9b79681 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:17.952070 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d46cb723-0887-4ecf-83c6-f639d9b79681 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:17.967457 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:37:18.081956 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-d46cb723-0887-4ecf-83c6-f639d9b79681 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:18.091628 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-d46cb723-0887-4ecf-83c6-f639d9b79681 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72" status: 200 len: 1271 microversion: 2.1 time: 0.153291 Jun 23 22:37:18.092770 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 85/162] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:17 2022] GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72 => generated 1271 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:37:18.105432 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-49e43de5-0c2a-47d0-8a8c-eeb7c9d75179 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:18.106806 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-49e43de5-0c2a-47d0-8a8c-eeb7c9d75179 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:18.113291 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-49e43de5-0c2a-47d0-8a8c-eeb7c9d75179 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:18.113773 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-49e43de5-0c2a-47d0-8a8c-eeb7c9d75179 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:18.114701 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-49e43de5-0c2a-47d0-8a8c-eeb7c9d75179 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:18.115205 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-49e43de5-0c2a-47d0-8a8c-eeb7c9d75179 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:18.288541 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-1810e9d0-5949-42b6-9ae9-9775f9049cd3 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c519b28b174ef385dd7e76b85cf504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becdae52e5c64b1ea2bb05833505b0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:18.300475 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-1810e9d0-5949-42b6-9ae9-9775f9049cd3 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] 10.222.0.43 "GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de" status: 200 len: 1552 microversion: 2.1 time: 0.459539 Jun 23 22:37:18.301220 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 78/163] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:17 2022] GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de => generated 1552 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:18.457497 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-49e43de5-0c2a-47d0-8a8c-eeb7c9d75179 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:18.467623 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-49e43de5-0c2a-47d0-8a8c-eeb7c9d75179 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1523 microversion: 2.1 time: 0.373447 Jun 23 22:37:18.468208 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 86/164] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:18 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1523 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:18.558351 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-a6134584-a76c-42a2-b90a-c14f1e7cd202 req-6f041763-a4d3-4e9d-b563-9090a1c97845 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b0ce8c1-d950-47d0-a644-bf09bb09b7de", "name": "network-vif-deleted", "tag": "c2d25909-b249-4e8a-bcb8-650a6616e3e6"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:37:18.571320 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-a6134584-a76c-42a2-b90a-c14f1e7cd202 req-6f041763-a4d3-4e9d-b563-9090a1c97845 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:18.571819 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-a6134584-a76c-42a2-b90a-c14f1e7cd202 req-6f041763-a4d3-4e9d-b563-9090a1c97845 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:18.587481 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-a6134584-a76c-42a2-b90a-c14f1e7cd202 req-6f041763-a4d3-4e9d-b563-9090a1c97845 service nova] Creating event network-vif-deleted:c2d25909-b249-4e8a-bcb8-650a6616e3e6 for instance 0b0ce8c1-d950-47d0-a644-bf09bb09b7de on hv-cinder-84617 Jun 23 22:37:18.593687 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-a6134584-a76c-42a2-b90a-c14f1e7cd202 req-6f041763-a4d3-4e9d-b563-9090a1c97845 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038880 Jun 23 22:37:18.594371 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 79/165] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:37:19.108884 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-68017de8-6eac-4db0-8d8a-cb37e7858090 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:19.109493 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-68017de8-6eac-4db0-8d8a-cb37e7858090 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: b98e3e93-9c53-4ff5-8a14-b0cf0a030c72] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:19.115494 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-68017de8-6eac-4db0-8d8a-cb37e7858090 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:19.115935 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-68017de8-6eac-4db0-8d8a-cb37e7858090 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:19.116692 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-68017de8-6eac-4db0-8d8a-cb37e7858090 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:19.117119 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-68017de8-6eac-4db0-8d8a-cb37e7858090 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:19.241819 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-68017de8-6eac-4db0-8d8a-cb37e7858090 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:19.249731 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-68017de8-6eac-4db0-8d8a-cb37e7858090 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72" status: 200 len: 1313 microversion: 2.1 time: 0.144837 Jun 23 22:37:19.250290 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 87/166] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:19 2022] GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:19.320559 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-9f5ba2a7-13be-4ef9-bb11-488bdecca92a tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:19.321241 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-9f5ba2a7-13be-4ef9-bb11-488bdecca92a tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:19.328195 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9f5ba2a7-13be-4ef9-bb11-488bdecca92a tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:19.328632 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9f5ba2a7-13be-4ef9-bb11-488bdecca92a tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:19.329380 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9f5ba2a7-13be-4ef9-bb11-488bdecca92a tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:19.331586 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9f5ba2a7-13be-4ef9-bb11-488bdecca92a tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:19.402868 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-9f5ba2a7-13be-4ef9-bb11-488bdecca92a tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c519b28b174ef385dd7e76b85cf504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becdae52e5c64b1ea2bb05833505b0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:19.412460 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-9f5ba2a7-13be-4ef9-bb11-488bdecca92a tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] 10.222.0.43 "GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de" status: 200 len: 1345 microversion: 2.1 time: 0.096386 Jun 23 22:37:19.413043 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 80/167] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:19 2022] GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de => generated 1345 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:19.484895 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-069e7103-effd-4744-ad47-5d57566c96fb tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:19.485345 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-069e7103-effd-4744-ad47-5d57566c96fb tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:19.491254 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-069e7103-effd-4744-ad47-5d57566c96fb tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:19.491723 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-069e7103-effd-4744-ad47-5d57566c96fb tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:19.492459 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-069e7103-effd-4744-ad47-5d57566c96fb tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:19.492883 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-069e7103-effd-4744-ad47-5d57566c96fb tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:19.617489 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-069e7103-effd-4744-ad47-5d57566c96fb tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:19.625564 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-069e7103-effd-4744-ad47-5d57566c96fb tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1523 microversion: 2.1 time: 0.144920 Jun 23 22:37:19.626123 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 88/168] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:19 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1523 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:20.265583 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-cab922ac-ce40-423d-822f-38186562d84a tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:20.266185 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-cab922ac-ce40-423d-822f-38186562d84a tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: b98e3e93-9c53-4ff5-8a14-b0cf0a030c72] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:20.272281 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cab922ac-ce40-423d-822f-38186562d84a tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:20.272840 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cab922ac-ce40-423d-822f-38186562d84a tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:20.273590 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cab922ac-ce40-423d-822f-38186562d84a tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:20.274014 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cab922ac-ce40-423d-822f-38186562d84a tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:20.411348 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-cab922ac-ce40-423d-822f-38186562d84a tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:20.418731 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-cab922ac-ce40-423d-822f-38186562d84a tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72" status: 200 len: 1313 microversion: 2.1 time: 0.157014 Jun 23 22:37:20.419338 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 81/169] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:20 2022] GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:20.429481 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-175e27eb-9d6f-472d-a5e1-99b6a92351a6 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:20.430092 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-175e27eb-9d6f-472d-a5e1-99b6a92351a6 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:20.436994 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-175e27eb-9d6f-472d-a5e1-99b6a92351a6 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:20.437440 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-175e27eb-9d6f-472d-a5e1-99b6a92351a6 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:20.438201 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-175e27eb-9d6f-472d-a5e1-99b6a92351a6 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:20.438762 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-175e27eb-9d6f-472d-a5e1-99b6a92351a6 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:20.522563 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-175e27eb-9d6f-472d-a5e1-99b6a92351a6 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c519b28b174ef385dd7e76b85cf504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becdae52e5c64b1ea2bb05833505b0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:20.532460 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-175e27eb-9d6f-472d-a5e1-99b6a92351a6 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] 10.222.0.43 "GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de" status: 200 len: 1345 microversion: 2.1 time: 0.106779 Jun 23 22:37:20.534019 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 89/170] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:20 2022] GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de => generated 1345 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:20.642049 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-ab78f4e4-fbc2-4344-bf7e-afbc546e0831 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:20.642580 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-ab78f4e4-fbc2-4344-bf7e-afbc546e0831 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:20.648579 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ab78f4e4-fbc2-4344-bf7e-afbc546e0831 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:20.649014 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ab78f4e4-fbc2-4344-bf7e-afbc546e0831 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:20.649762 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ab78f4e4-fbc2-4344-bf7e-afbc546e0831 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:20.650184 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ab78f4e4-fbc2-4344-bf7e-afbc546e0831 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:20.878006 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ab78f4e4-fbc2-4344-bf7e-afbc546e0831 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:20.885714 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-ab78f4e4-fbc2-4344-bf7e-afbc546e0831 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1523 microversion: 2.1 time: 0.247555 Jun 23 22:37:20.886287 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 82/171] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:20 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1523 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:21.159553 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [req-ff83961c-f404-44ed-91c0-b40244961450 req-dbe3eff3-0dbf-4ef3-8b99-80842342aa98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b98e3e93-9c53-4ff5-8a14-b0cf0a030c72", "tag": "d186a1fc-d1bb-4e7e-bf24-f8735a9f9358"}]} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:37:21.168037 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-ff83961c-f404-44ed-91c0-b40244961450 req-dbe3eff3-0dbf-4ef3-8b99-80842342aa98 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:21.169115 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-ff83961c-f404-44ed-91c0-b40244961450 req-dbe3eff3-0dbf-4ef3-8b99-80842342aa98 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:21.181013 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.compute.server_external_events [req-ff83961c-f404-44ed-91c0-b40244961450 req-dbe3eff3-0dbf-4ef3-8b99-80842342aa98 service nova] Creating event network-changed:d186a1fc-d1bb-4e7e-bf24-f8735a9f9358 for instance b98e3e93-9c53-4ff5-8a14-b0cf0a030c72 on hv-cinder-84617 Jun 23 22:37:21.186827 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [req-ff83961c-f404-44ed-91c0-b40244961450 req-dbe3eff3-0dbf-4ef3-8b99-80842342aa98 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031355 Jun 23 22:37:21.187465 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 90/172] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:37:21.435092 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-21e4b6f2-412e-43ea-891a-fdfb36dd0a75 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:21.435824 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-21e4b6f2-412e-43ea-891a-fdfb36dd0a75 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: b98e3e93-9c53-4ff5-8a14-b0cf0a030c72] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:21.438349 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=2 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:37:21.444562 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-21e4b6f2-412e-43ea-891a-fdfb36dd0a75 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:21.445304 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-21e4b6f2-412e-43ea-891a-fdfb36dd0a75 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:21.446178 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-21e4b6f2-412e-43ea-891a-fdfb36dd0a75 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:21.454050 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-21e4b6f2-412e-43ea-891a-fdfb36dd0a75 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:21.550199 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-832955eb-acf8-428d-b7e8-5dedffc75a37 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:21.550893 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-832955eb-acf8-428d-b7e8-5dedffc75a37 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:21.552879 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell0:SELECT=2 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:37:21.553742 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell0:SELECT=6 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:37:21.558800 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-832955eb-acf8-428d-b7e8-5dedffc75a37 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:21.559988 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-832955eb-acf8-428d-b7e8-5dedffc75a37 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:21.561068 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-832955eb-acf8-428d-b7e8-5dedffc75a37 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:21.561690 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-832955eb-acf8-428d-b7e8-5dedffc75a37 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:21.595313 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-21e4b6f2-412e-43ea-891a-fdfb36dd0a75 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:21.598884 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:37:21.603927 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-21e4b6f2-412e-43ea-891a-fdfb36dd0a75 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72" status: 200 len: 1313 microversion: 2.1 time: 0.172788 Jun 23 22:37:21.604492 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 83/173] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:21 2022] GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:21.643591 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-832955eb-acf8-428d-b7e8-5dedffc75a37 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c519b28b174ef385dd7e76b85cf504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becdae52e5c64b1ea2bb05833505b0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:21.651674 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-832955eb-acf8-428d-b7e8-5dedffc75a37 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] 10.222.0.43 "GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de" status: 200 len: 1345 microversion: 2.1 time: 0.105394 Jun 23 22:37:21.652181 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 91/174] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:21 2022] GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de => generated 1345 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:21.907292 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-04ed163e-d430-4426-9e08-d08670743433 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:21.908046 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-04ed163e-d430-4426-9e08-d08670743433 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:21.915495 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-04ed163e-d430-4426-9e08-d08670743433 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:21.915937 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-04ed163e-d430-4426-9e08-d08670743433 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:21.916707 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-04ed163e-d430-4426-9e08-d08670743433 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:21.917138 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-04ed163e-d430-4426-9e08-d08670743433 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:22.051009 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-04ed163e-d430-4426-9e08-d08670743433 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:22.058400 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-04ed163e-d430-4426-9e08-d08670743433 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1523 microversion: 2.1 time: 0.156621 Jun 23 22:37:22.058977 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 84/175] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:21 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:22.624435 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-f4ea23be-efac-4452-9c5f-9bcf4dc5ce50 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:22.624997 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-f4ea23be-efac-4452-9c5f-9bcf4dc5ce50 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: b98e3e93-9c53-4ff5-8a14-b0cf0a030c72] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:22.631113 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f4ea23be-efac-4452-9c5f-9bcf4dc5ce50 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:22.631557 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f4ea23be-efac-4452-9c5f-9bcf4dc5ce50 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:22.632303 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f4ea23be-efac-4452-9c5f-9bcf4dc5ce50 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:22.632729 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f4ea23be-efac-4452-9c5f-9bcf4dc5ce50 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:22.668699 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-2080beef-ace3-4ca1-bba6-00b1f71bc334 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:22.669313 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-2080beef-ace3-4ca1-bba6-00b1f71bc334 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:22.675928 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2080beef-ace3-4ca1-bba6-00b1f71bc334 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:22.676369 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2080beef-ace3-4ca1-bba6-00b1f71bc334 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:22.677136 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2080beef-ace3-4ca1-bba6-00b1f71bc334 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:22.677565 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2080beef-ace3-4ca1-bba6-00b1f71bc334 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:22.744660 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-2080beef-ace3-4ca1-bba6-00b1f71bc334 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c519b28b174ef385dd7e76b85cf504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becdae52e5c64b1ea2bb05833505b0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:22.752630 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-2080beef-ace3-4ca1-bba6-00b1f71bc334 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] 10.222.0.43 "GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de" status: 200 len: 1345 microversion: 2.1 time: 0.087810 Jun 23 22:37:22.753202 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 85/176] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:22 2022] GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de => generated 1345 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:37:22.779722 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-f4ea23be-efac-4452-9c5f-9bcf4dc5ce50 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:22.787637 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-f4ea23be-efac-4452-9c5f-9bcf4dc5ce50 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72" status: 200 len: 1313 microversion: 2.1 time: 0.167524 Jun 23 22:37:22.788467 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 92/177] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:22 2022] GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:23.078003 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e83b33a0-1b25-4a33-9bed-78c49bcf458b tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:23.078631 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e83b33a0-1b25-4a33-9bed-78c49bcf458b tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:23.084683 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e83b33a0-1b25-4a33-9bed-78c49bcf458b tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:23.085118 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e83b33a0-1b25-4a33-9bed-78c49bcf458b tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:23.085861 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e83b33a0-1b25-4a33-9bed-78c49bcf458b tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:23.086285 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e83b33a0-1b25-4a33-9bed-78c49bcf458b tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:23.218459 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e83b33a0-1b25-4a33-9bed-78c49bcf458b tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:23.226154 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e83b33a0-1b25-4a33-9bed-78c49bcf458b tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1523 microversion: 2.1 time: 0.153172 Jun 23 22:37:23.226724 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 86/178] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:23 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:23.769429 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-66678ee3-bd80-43b5-b68d-983c8bbfaeeb tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:23.769969 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-66678ee3-bd80-43b5-b68d-983c8bbfaeeb tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:23.776072 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-66678ee3-bd80-43b5-b68d-983c8bbfaeeb tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:23.776383 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-66678ee3-bd80-43b5-b68d-983c8bbfaeeb tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:23.777177 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-66678ee3-bd80-43b5-b68d-983c8bbfaeeb tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:23.777562 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-66678ee3-bd80-43b5-b68d-983c8bbfaeeb tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:23.804860 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f39b9025-69ee-445e-8de8-353dd1860939 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:23.805463 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-f39b9025-69ee-445e-8de8-353dd1860939 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: b98e3e93-9c53-4ff5-8a14-b0cf0a030c72] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:23.812647 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f39b9025-69ee-445e-8de8-353dd1860939 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:23.813087 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f39b9025-69ee-445e-8de8-353dd1860939 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:23.813846 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f39b9025-69ee-445e-8de8-353dd1860939 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:23.814273 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f39b9025-69ee-445e-8de8-353dd1860939 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:23.888822 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-66678ee3-bd80-43b5-b68d-983c8bbfaeeb tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53c519b28b174ef385dd7e76b85cf504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becdae52e5c64b1ea2bb05833505b0f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:23.896839 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-66678ee3-bd80-43b5-b68d-983c8bbfaeeb tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] 10.222.0.43 "GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de" status: 200 len: 1345 microversion: 2.1 time: 0.131397 Jun 23 22:37:23.897407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 93/179] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:23 2022] GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de => generated 1345 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:24.104234 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f39b9025-69ee-445e-8de8-353dd1860939 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:24.112500 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f39b9025-69ee-445e-8de8-353dd1860939 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72" status: 200 len: 1313 microversion: 2.1 time: 0.311344 Jun 23 22:37:24.113256 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 87/180] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:23 2022] GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72 => generated 1313 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:37:24.242857 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-82c4f1f9-48f0-481a-86c8-5a715ed7f65f tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:24.243622 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-82c4f1f9-48f0-481a-86c8-5a715ed7f65f tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:24.245524 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:37:24.251744 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-82c4f1f9-48f0-481a-86c8-5a715ed7f65f tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:24.252184 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-82c4f1f9-48f0-481a-86c8-5a715ed7f65f tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:24.252939 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-82c4f1f9-48f0-481a-86c8-5a715ed7f65f tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:24.253372 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-82c4f1f9-48f0-481a-86c8-5a715ed7f65f tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:24.396336 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-82c4f1f9-48f0-481a-86c8-5a715ed7f65f tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:24.404514 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-82c4f1f9-48f0-481a-86c8-5a715ed7f65f tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1523 microversion: 2.1 time: 0.165534 Jun 23 22:37:24.405066 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 94/181] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:24 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:24.915753 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c5f872e4-cb6b-498d-9eda-6bf1d9944bfd tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:24.917723 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c5f872e4-cb6b-498d-9eda-6bf1d9944bfd tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:24.927736 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c5f872e4-cb6b-498d-9eda-6bf1d9944bfd tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:24.929448 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c5f872e4-cb6b-498d-9eda-6bf1d9944bfd tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:24.930726 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c5f872e4-cb6b-498d-9eda-6bf1d9944bfd tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:24.931504 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c5f872e4-cb6b-498d-9eda-6bf1d9944bfd tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:24.947938 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-c5f872e4-cb6b-498d-9eda-6bf1d9944bfd tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] HTTP exception thrown: Instance 0b0ce8c1-d950-47d0-a644-bf09bb09b7de could not be found. Jun 23 22:37:24.953754 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c5f872e4-cb6b-498d-9eda-6bf1d9944bfd tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Request method failure captured: Jun 23 22:37:24.953754 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: request: GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de HTTP/1.1 Jun 23 22:37:24.953754 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept: application/json Jun 23 22:37:24.953754 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Jun 23 22:37:24.953754 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Connection: close Jun 23 22:37:24.953754 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Length: 0 Jun 23 22:37:24.953754 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Type: application/json Jun 23 22:37:24.953754 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Host: 10.222.0.43 Jun 23 22:37:24.953754 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Jun 23 22:37:24.953754 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.9 Jun 23 22:37:24.953754 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABitOrcriL1kiD0c4KJKp_J8Arf8fGDeWoPJ8vetzFvDw4Yiu9ye1zpJKZSpeJAuwg2TkdEU5s86sdyA4gHURQuz55Eb74CNB1aaqOhEPXfeagcZcZ4AQkyz2XBePd-sWHTHPy3NVk_gf5TO_gz0fQ_U8q-mbtMhhPkF_cRmsRexy2y8bM Jun 23 22:37:24.953754 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Jun 23 22:37:24.953754 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Jun 23 22:37:24.953754 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Jun 23 22:37:24.953754 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Jun 23 22:37:24.953754 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Jun 23 22:37:24.953754 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Jun 23 22:37:24.953754 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Id: becdae52e5c64b1ea2bb05833505b0f8 Jun 23 22:37:24.953754 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-DeleteServersTestJSON-60510095 Jun 23 22:37:24.953754 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Role: reader,member Jun 23 22:37:24.953754 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Roles: reader,member Jun 23 22:37:24.955007 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/becdae52e5c64b1ea2bb05833505b0f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/becdae52e5c64b1ea2bb05833505b0f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_becdae52e5c64b1ea2bb05833505b0f8", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/becdae52e5c64b1ea2bb05833505b0f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:37:24.955007 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-DeleteServersTestJSON-60510095 Jun 23 22:37:24.955007 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Id: becdae52e5c64b1ea2bb05833505b0f8 Jun 23 22:37:24.955007 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-DeleteServersTestJSON-60510095 Jun 23 22:37:24.955007 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User: tempest-DeleteServersTestJSON-60510095-project Jun 23 22:37:24.955007 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Jun 23 22:37:24.955007 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Jun 23 22:37:24.955007 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Id: 53c519b28b174ef385dd7e76b85cf504 Jun 23 22:37:24.955007 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-DeleteServersTestJSON-60510095-project Jun 23 22:37:24.955007 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: method: > Jun 23 22:37:24.955007 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: exception: Instance 0b0ce8c1-d950-47d0-a644-bf09bb09b7de could not be found. Jun 23 22:37:24.955007 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: action_args: {'id': '0b0ce8c1-d950-47d0-a644-bf09bb09b7de'} Jun 23 22:37:24.955681 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:37:24.955681 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:37:24.955681 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:37:24.955681 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:37:24.955681 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:37:24.955681 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:37:24.955681 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:37:24.955681 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:37:24.955681 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:37:24.955681 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:37:24.955681 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b0ce8c1-d950-47d0-a644-bf09bb09b7de could not be found. Jun 23 22:37:24.955681 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:37:24.955681 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:37:24.955681 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:37:24.955681 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:37:24.955681 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:37:24.955681 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:37:24.955681 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:37:24.955681 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:37:24.955681 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:37:24.956836 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:37:24.956836 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:37:24.956836 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:37:24.956836 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:37:24.956836 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:37:24.956836 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:37:24.956836 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:37:24.956836 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b0ce8c1-d950-47d0-a644-bf09bb09b7de could not be found. Jun 23 22:37:24.956836 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:37:24.956836 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:37:24.956836 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:37:24.956836 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:37:24.956836 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:37:24.956836 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:37:24.956836 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:37:24.956836 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:37:24.956836 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b0ce8c1-d950-47d0-a644-bf09bb09b7de could not be found. Jun 23 22:37:24.956836 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:37:24.959978 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c5f872e4-cb6b-498d-9eda-6bf1d9944bfd tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Returning 404 to user: Instance 0b0ce8c1-d950-47d0-a644-bf09bb09b7de could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:37:24.961153 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c5f872e4-cb6b-498d-9eda-6bf1d9944bfd tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] 10.222.0.43 "GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de" status: 404 len: 111 microversion: 2.1 time: 0.050254 Jun 23 22:37:24.962195 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 88/182] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:24 2022] GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:37:25.132140 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-141ef97f-f10f-496a-afcc-773a31799cb8 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:25.133355 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-141ef97f-f10f-496a-afcc-773a31799cb8 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: b98e3e93-9c53-4ff5-8a14-b0cf0a030c72] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:25.150483 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-141ef97f-f10f-496a-afcc-773a31799cb8 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:25.150935 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-141ef97f-f10f-496a-afcc-773a31799cb8 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:25.151702 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-141ef97f-f10f-496a-afcc-773a31799cb8 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:25.152128 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-141ef97f-f10f-496a-afcc-773a31799cb8 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:25.308686 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e0639410-9427-47f1-8fde-cfadbbb30639 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:25.310377 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e0639410-9427-47f1-8fde-cfadbbb30639 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:25.320834 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e0639410-9427-47f1-8fde-cfadbbb30639 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:25.321284 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e0639410-9427-47f1-8fde-cfadbbb30639 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:25.322048 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e0639410-9427-47f1-8fde-cfadbbb30639 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:25.322776 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e0639410-9427-47f1-8fde-cfadbbb30639 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:25.344850 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-e0639410-9427-47f1-8fde-cfadbbb30639 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] HTTP exception thrown: Instance 0b0ce8c1-d950-47d0-a644-bf09bb09b7de could not be found. Jun 23 22:37:25.346175 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e0639410-9427-47f1-8fde-cfadbbb30639 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Request method failure captured: Jun 23 22:37:25.346175 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: request: GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de/os-volume_attachments HTTP/1.1 Jun 23 22:37:25.346175 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept: application/json Jun 23 22:37:25.346175 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Jun 23 22:37:25.346175 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Connection: close Jun 23 22:37:25.346175 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Length: 0 Jun 23 22:37:25.346175 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Type: application/json Jun 23 22:37:25.346175 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Host: 10.222.0.43 Jun 23 22:37:25.346175 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Jun 23 22:37:25.346175 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.9 Jun 23 22:37:25.346175 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABitOrcriL1kiD0c4KJKp_J8Arf8fGDeWoPJ8vetzFvDw4Yiu9ye1zpJKZSpeJAuwg2TkdEU5s86sdyA4gHURQuz55Eb74CNB1aaqOhEPXfeagcZcZ4AQkyz2XBePd-sWHTHPy3NVk_gf5TO_gz0fQ_U8q-mbtMhhPkF_cRmsRexy2y8bM Jun 23 22:37:25.346175 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Jun 23 22:37:25.346175 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Jun 23 22:37:25.346175 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Jun 23 22:37:25.346175 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Jun 23 22:37:25.346175 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Jun 23 22:37:25.346175 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Jun 23 22:37:25.346175 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Id: becdae52e5c64b1ea2bb05833505b0f8 Jun 23 22:37:25.346175 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-DeleteServersTestJSON-60510095 Jun 23 22:37:25.346175 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Role: reader,member Jun 23 22:37:25.346175 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Roles: reader,member Jun 23 22:37:25.347456 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/becdae52e5c64b1ea2bb05833505b0f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/becdae52e5c64b1ea2bb05833505b0f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_becdae52e5c64b1ea2bb05833505b0f8", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/becdae52e5c64b1ea2bb05833505b0f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:37:25.347456 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-DeleteServersTestJSON-60510095 Jun 23 22:37:25.347456 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Id: becdae52e5c64b1ea2bb05833505b0f8 Jun 23 22:37:25.347456 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-DeleteServersTestJSON-60510095 Jun 23 22:37:25.347456 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User: tempest-DeleteServersTestJSON-60510095-project Jun 23 22:37:25.347456 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Jun 23 22:37:25.347456 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Jun 23 22:37:25.347456 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Id: 53c519b28b174ef385dd7e76b85cf504 Jun 23 22:37:25.347456 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-DeleteServersTestJSON-60510095-project Jun 23 22:37:25.347456 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: method: > Jun 23 22:37:25.347456 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: exception: Instance 0b0ce8c1-d950-47d0-a644-bf09bb09b7de could not be found. Jun 23 22:37:25.347456 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: action_args: {'server_id': '0b0ce8c1-d950-47d0-a644-bf09bb09b7de'} Jun 23 22:37:25.348135 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:37:25.348135 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:37:25.348135 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:37:25.348135 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:37:25.348135 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:37:25.348135 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:37:25.348135 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:37:25.348135 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:37:25.348135 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:37:25.348135 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:37:25.348135 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b0ce8c1-d950-47d0-a644-bf09bb09b7de could not be found. Jun 23 22:37:25.348135 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:37:25.348135 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:37:25.348135 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:37:25.348135 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:37:25.348135 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:37:25.348135 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:37:25.348135 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:37:25.348135 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:37:25.348135 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:37:25.353150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:37:25.353150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 23 22:37:25.353150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 22:37:25.353150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 23 22:37:25.353150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 22:37:25.353150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 23 22:37:25.353150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 23 22:37:25.353150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:37:25.353150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:37:25.353150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b0ce8c1-d950-47d0-a644-bf09bb09b7de could not be found. Jun 23 22:37:25.353150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:37:25.353150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:37:25.353150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:37:25.353150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:37:25.353150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:37:25.353150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:37:25.353150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:37:25.353150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:37:25.353150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b0ce8c1-d950-47d0-a644-bf09bb09b7de could not be found. Jun 23 22:37:25.353150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:37:25.354211 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e0639410-9427-47f1-8fde-cfadbbb30639 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Returning 404 to user: Instance 0b0ce8c1-d950-47d0-a644-bf09bb09b7de could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:37:25.354211 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e0639410-9427-47f1-8fde-cfadbbb30639 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] 10.222.0.43 "GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.046333 Jun 23 22:37:25.354211 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 89/183] 10.222.0.43 () {58 vars in 1301 bytes} [Thu Jun 23 22:37:25 2022] GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de/os-volume_attachments => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:37:25.369279 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-141ef97f-f10f-496a-afcc-773a31799cb8 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:25.377656 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-141ef97f-f10f-496a-afcc-773a31799cb8 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72" status: 200 len: 1313 microversion: 2.1 time: 0.251716 Jun 23 22:37:25.387775 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 95/184] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:25 2022] GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72 => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:25.423380 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-5b3c1587-3d11-4479-84cc-70bc2802d16c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:25.423987 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-5b3c1587-3d11-4479-84cc-70bc2802d16c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:25.431678 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5b3c1587-3d11-4479-84cc-70bc2802d16c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:25.432117 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5b3c1587-3d11-4479-84cc-70bc2802d16c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:25.433021 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5b3c1587-3d11-4479-84cc-70bc2802d16c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:25.433445 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5b3c1587-3d11-4479-84cc-70bc2802d16c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:25.578952 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-5b3c1587-3d11-4479-84cc-70bc2802d16c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:25.586638 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-5b3c1587-3d11-4479-84cc-70bc2802d16c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1523 microversion: 2.1 time: 0.168900 Jun 23 22:37:25.587247 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 90/185] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:25 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:26.394410 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-5e72ee86-d48a-4fe9-aee3-4c9fb4e07b77 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:26.395148 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-5e72ee86-d48a-4fe9-aee3-4c9fb4e07b77 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: b98e3e93-9c53-4ff5-8a14-b0cf0a030c72] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:26.406086 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5e72ee86-d48a-4fe9-aee3-4c9fb4e07b77 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:26.406517 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5e72ee86-d48a-4fe9-aee3-4c9fb4e07b77 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:26.407335 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5e72ee86-d48a-4fe9-aee3-4c9fb4e07b77 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:26.407806 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5e72ee86-d48a-4fe9-aee3-4c9fb4e07b77 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:26.555159 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-5e72ee86-d48a-4fe9-aee3-4c9fb4e07b77 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:26.563849 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-5e72ee86-d48a-4fe9-aee3-4c9fb4e07b77 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72" status: 200 len: 1313 microversion: 2.1 time: 0.173367 Jun 23 22:37:26.564424 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 96/186] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:26 2022] GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:26.565700 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-986bf6f9-a9d0-4f3e-8588-ffa218bd0078 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:26.566755 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-986bf6f9-a9d0-4f3e-8588-ffa218bd0078 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:26.574553 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-986bf6f9-a9d0-4f3e-8588-ffa218bd0078 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:26.575729 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-986bf6f9-a9d0-4f3e-8588-ffa218bd0078 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:26.576645 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-986bf6f9-a9d0-4f3e-8588-ffa218bd0078 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:26.577144 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-986bf6f9-a9d0-4f3e-8588-ffa218bd0078 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:26.592855 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-986bf6f9-a9d0-4f3e-8588-ffa218bd0078 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] HTTP exception thrown: Instance 0b0ce8c1-d950-47d0-a644-bf09bb09b7de could not be found. Jun 23 22:37:26.594413 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-986bf6f9-a9d0-4f3e-8588-ffa218bd0078 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Request method failure captured: Jun 23 22:37:26.594413 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: request: DELETE /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de HTTP/1.1 Jun 23 22:37:26.594413 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept: application/json Jun 23 22:37:26.594413 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Jun 23 22:37:26.594413 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Connection: close Jun 23 22:37:26.594413 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Length: 0 Jun 23 22:37:26.594413 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Type: application/json Jun 23 22:37:26.594413 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Host: 10.222.0.43 Jun 23 22:37:26.594413 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Jun 23 22:37:26.594413 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.9 Jun 23 22:37:26.594413 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABitOrcriL1kiD0c4KJKp_J8Arf8fGDeWoPJ8vetzFvDw4Yiu9ye1zpJKZSpeJAuwg2TkdEU5s86sdyA4gHURQuz55Eb74CNB1aaqOhEPXfeagcZcZ4AQkyz2XBePd-sWHTHPy3NVk_gf5TO_gz0fQ_U8q-mbtMhhPkF_cRmsRexy2y8bM Jun 23 22:37:26.594413 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Jun 23 22:37:26.594413 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Jun 23 22:37:26.594413 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Jun 23 22:37:26.594413 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Jun 23 22:37:26.594413 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Jun 23 22:37:26.594413 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Jun 23 22:37:26.594413 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Id: becdae52e5c64b1ea2bb05833505b0f8 Jun 23 22:37:26.594413 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-DeleteServersTestJSON-60510095 Jun 23 22:37:26.594413 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Role: reader,member Jun 23 22:37:26.594413 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Roles: reader,member Jun 23 22:37:26.595726 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/becdae52e5c64b1ea2bb05833505b0f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/becdae52e5c64b1ea2bb05833505b0f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_becdae52e5c64b1ea2bb05833505b0f8", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/becdae52e5c64b1ea2bb05833505b0f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:37:26.595726 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-DeleteServersTestJSON-60510095 Jun 23 22:37:26.595726 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Id: becdae52e5c64b1ea2bb05833505b0f8 Jun 23 22:37:26.595726 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-DeleteServersTestJSON-60510095 Jun 23 22:37:26.595726 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User: tempest-DeleteServersTestJSON-60510095-project Jun 23 22:37:26.595726 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Jun 23 22:37:26.595726 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Jun 23 22:37:26.595726 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Id: 53c519b28b174ef385dd7e76b85cf504 Jun 23 22:37:26.595726 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-DeleteServersTestJSON-60510095-project Jun 23 22:37:26.595726 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: method: > Jun 23 22:37:26.595726 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: exception: Instance 0b0ce8c1-d950-47d0-a644-bf09bb09b7de could not be found. Jun 23 22:37:26.595726 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: action_args: {'id': '0b0ce8c1-d950-47d0-a644-bf09bb09b7de'} Jun 23 22:37:26.596458 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:37:26.596458 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:37:26.596458 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:37:26.596458 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:37:26.596458 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:37:26.596458 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:37:26.596458 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:37:26.596458 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:37:26.596458 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:37:26.596458 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:37:26.596458 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b0ce8c1-d950-47d0-a644-bf09bb09b7de could not be found. Jun 23 22:37:26.596458 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:37:26.596458 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:37:26.596458 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:37:26.596458 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:37:26.596458 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:37:26.596458 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:37:26.596458 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:37:26.596458 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:37:26.596458 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:37:26.597563 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:37:26.597563 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 22:37:26.597563 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 22:37:26.597563 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 22:37:26.597563 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 22:37:26.597563 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:37:26.597563 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:37:26.597563 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:37:26.597563 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:37:26.597563 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b0ce8c1-d950-47d0-a644-bf09bb09b7de could not be found. Jun 23 22:37:26.597563 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:37:26.597563 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:37:26.597563 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:37:26.597563 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:37:26.597563 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:37:26.597563 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:37:26.597563 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:37:26.597563 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:37:26.597563 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b0ce8c1-d950-47d0-a644-bf09bb09b7de could not be found. Jun 23 22:37:26.597563 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:37:26.598609 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-986bf6f9-a9d0-4f3e-8588-ffa218bd0078 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Returning 404 to user: Instance 0b0ce8c1-d950-47d0-a644-bf09bb09b7de could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:37:26.598609 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-986bf6f9-a9d0-4f3e-8588-ffa218bd0078 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de" status: 404 len: 111 microversion: 2.1 time: 0.035114 Jun 23 22:37:26.598609 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 91/187] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 23 22:37:26 2022] DELETE /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 22:37:26.604907 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-939f8ca8-ade1-4e4d-b3b0-90db34f01ce5 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:26.605031 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-7ffb2f4c-9571-40dc-9f20-8b4b2e9ff6e6 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:26.605612 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-7ffb2f4c-9571-40dc-9f20-8b4b2e9ff6e6 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] [instance: 0b0ce8c1-d950-47d0-a644-bf09bb09b7de] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:26.606010 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-939f8ca8-ade1-4e4d-b3b0-90db34f01ce5 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:26.611965 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7ffb2f4c-9571-40dc-9f20-8b4b2e9ff6e6 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:26.612402 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-939f8ca8-ade1-4e4d-b3b0-90db34f01ce5 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:26.612646 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7ffb2f4c-9571-40dc-9f20-8b4b2e9ff6e6 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:26.613182 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-939f8ca8-ade1-4e4d-b3b0-90db34f01ce5 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:26.613307 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7ffb2f4c-9571-40dc-9f20-8b4b2e9ff6e6 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:26.613621 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7ffb2f4c-9571-40dc-9f20-8b4b2e9ff6e6 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:26.614077 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-939f8ca8-ade1-4e4d-b3b0-90db34f01ce5 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:26.614576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-939f8ca8-ade1-4e4d-b3b0-90db34f01ce5 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:26.628544 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-7ffb2f4c-9571-40dc-9f20-8b4b2e9ff6e6 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] HTTP exception thrown: Instance 0b0ce8c1-d950-47d0-a644-bf09bb09b7de could not be found. Jun 23 22:37:26.630540 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-7ffb2f4c-9571-40dc-9f20-8b4b2e9ff6e6 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Request method failure captured: Jun 23 22:37:26.630540 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: request: GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de HTTP/1.1 Jun 23 22:37:26.630540 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept: application/json Jun 23 22:37:26.630540 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Jun 23 22:37:26.630540 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Connection: close Jun 23 22:37:26.630540 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Length: 0 Jun 23 22:37:26.630540 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Type: application/json Jun 23 22:37:26.630540 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Host: 10.222.0.43 Jun 23 22:37:26.630540 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Jun 23 22:37:26.630540 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.9 Jun 23 22:37:26.630540 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABitOrcriL1kiD0c4KJKp_J8Arf8fGDeWoPJ8vetzFvDw4Yiu9ye1zpJKZSpeJAuwg2TkdEU5s86sdyA4gHURQuz55Eb74CNB1aaqOhEPXfeagcZcZ4AQkyz2XBePd-sWHTHPy3NVk_gf5TO_gz0fQ_U8q-mbtMhhPkF_cRmsRexy2y8bM Jun 23 22:37:26.630540 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Jun 23 22:37:26.630540 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Jun 23 22:37:26.630540 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Jun 23 22:37:26.630540 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Jun 23 22:37:26.630540 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Jun 23 22:37:26.630540 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Jun 23 22:37:26.630540 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Id: becdae52e5c64b1ea2bb05833505b0f8 Jun 23 22:37:26.630540 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-DeleteServersTestJSON-60510095 Jun 23 22:37:26.630540 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Role: reader,member Jun 23 22:37:26.630540 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Roles: reader,member Jun 23 22:37:26.631760 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/becdae52e5c64b1ea2bb05833505b0f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/becdae52e5c64b1ea2bb05833505b0f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_becdae52e5c64b1ea2bb05833505b0f8", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/becdae52e5c64b1ea2bb05833505b0f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:37:26.631760 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-DeleteServersTestJSON-60510095 Jun 23 22:37:26.631760 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Id: becdae52e5c64b1ea2bb05833505b0f8 Jun 23 22:37:26.631760 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-DeleteServersTestJSON-60510095 Jun 23 22:37:26.631760 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User: tempest-DeleteServersTestJSON-60510095-project Jun 23 22:37:26.631760 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Jun 23 22:37:26.631760 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Jun 23 22:37:26.631760 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Id: 53c519b28b174ef385dd7e76b85cf504 Jun 23 22:37:26.631760 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-DeleteServersTestJSON-60510095-project Jun 23 22:37:26.631760 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: method: > Jun 23 22:37:26.631760 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: exception: Instance 0b0ce8c1-d950-47d0-a644-bf09bb09b7de could not be found. Jun 23 22:37:26.631760 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: action_args: {'id': '0b0ce8c1-d950-47d0-a644-bf09bb09b7de'} Jun 23 22:37:26.632430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:37:26.632430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:37:26.632430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:37:26.632430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:37:26.632430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:37:26.632430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:37:26.632430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:37:26.632430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:37:26.632430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:37:26.632430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:37:26.632430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b0ce8c1-d950-47d0-a644-bf09bb09b7de could not be found. Jun 23 22:37:26.632430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:37:26.632430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:37:26.632430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:37:26.632430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:37:26.632430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:37:26.632430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:37:26.632430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:37:26.632430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:37:26.632430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:37:26.633554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:37:26.633554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:37:26.633554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:37:26.633554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:37:26.633554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:37:26.633554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:37:26.633554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:37:26.633554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b0ce8c1-d950-47d0-a644-bf09bb09b7de could not be found. Jun 23 22:37:26.633554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:37:26.633554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:37:26.633554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:37:26.633554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:37:26.633554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:37:26.633554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:37:26.633554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:37:26.633554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:37:26.633554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b0ce8c1-d950-47d0-a644-bf09bb09b7de could not be found. Jun 23 22:37:26.633554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:37:26.634579 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-7ffb2f4c-9571-40dc-9f20-8b4b2e9ff6e6 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] Returning 404 to user: Instance 0b0ce8c1-d950-47d0-a644-bf09bb09b7de could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:37:26.634579 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-7ffb2f4c-9571-40dc-9f20-8b4b2e9ff6e6 tempest-DeleteServersTestJSON-60510095 tempest-DeleteServersTestJSON-60510095-project] 10.222.0.43 "GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de" status: 404 len: 111 microversion: 2.1 time: 0.030979 Jun 23 22:37:26.634579 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 92/188] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:26 2022] GET /compute/v2.1/servers/0b0ce8c1-d950-47d0-a644-bf09bb09b7de => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:37:26.841005 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-939f8ca8-ade1-4e4d-b3b0-90db34f01ce5 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:26.848349 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-939f8ca8-ade1-4e4d-b3b0-90db34f01ce5 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1523 microversion: 2.1 time: 0.247714 Jun 23 22:37:26.848913 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 97/189] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:26 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1523 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:27.580647 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d81637e0-0538-469f-9915-a235a0628cbf tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:27.581264 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-d81637e0-0538-469f-9915-a235a0628cbf tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: b98e3e93-9c53-4ff5-8a14-b0cf0a030c72] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:27.596377 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d81637e0-0538-469f-9915-a235a0628cbf tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:27.596824 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d81637e0-0538-469f-9915-a235a0628cbf tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:27.597602 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d81637e0-0538-469f-9915-a235a0628cbf tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:27.598037 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d81637e0-0538-469f-9915-a235a0628cbf tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:27.863251 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d81637e0-0538-469f-9915-a235a0628cbf tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:27.865741 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-a1085e39-1341-42a3-bc3d-9320462b25ae tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:27.866461 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-a1085e39-1341-42a3-bc3d-9320462b25ae tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:27.871138 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d81637e0-0538-469f-9915-a235a0628cbf tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72" status: 200 len: 1313 microversion: 2.1 time: 0.294124 Jun 23 22:37:27.871809 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 93/190] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:27 2022] GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72 => generated 1313 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:27.883537 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a1085e39-1341-42a3-bc3d-9320462b25ae tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:27.884086 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a1085e39-1341-42a3-bc3d-9320462b25ae tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:27.885888 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a1085e39-1341-42a3-bc3d-9320462b25ae tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:27.886439 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a1085e39-1341-42a3-bc3d-9320462b25ae tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:28.143241 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-a1085e39-1341-42a3-bc3d-9320462b25ae tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:28.152076 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-a1085e39-1341-42a3-bc3d-9320462b25ae tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1523 microversion: 2.1 time: 0.290327 Jun 23 22:37:28.163016 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 98/191] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:27 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1523 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:28.889180 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-ccc51aa6-9562-49a6-9bb7-d98832e1b99a tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:28.889852 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-ccc51aa6-9562-49a6-9bb7-d98832e1b99a tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: b98e3e93-9c53-4ff5-8a14-b0cf0a030c72] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:28.899883 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ccc51aa6-9562-49a6-9bb7-d98832e1b99a tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:28.900333 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ccc51aa6-9562-49a6-9bb7-d98832e1b99a tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:28.910978 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ccc51aa6-9562-49a6-9bb7-d98832e1b99a tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:28.911757 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ccc51aa6-9562-49a6-9bb7-d98832e1b99a tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:29.136428 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ccc51aa6-9562-49a6-9bb7-d98832e1b99a tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:29.144942 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-ccc51aa6-9562-49a6-9bb7-d98832e1b99a tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72" status: 200 len: 1313 microversion: 2.1 time: 0.260067 Jun 23 22:37:29.145545 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 94/192] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:28 2022] GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72 => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:29.181087 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-348cf442-ce1c-4d17-a2d0-507a4dcf35ee tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:29.182653 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-348cf442-ce1c-4d17-a2d0-507a4dcf35ee tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:29.191176 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-348cf442-ce1c-4d17-a2d0-507a4dcf35ee tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:29.191958 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-348cf442-ce1c-4d17-a2d0-507a4dcf35ee tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:29.192721 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-348cf442-ce1c-4d17-a2d0-507a4dcf35ee tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:29.193301 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-348cf442-ce1c-4d17-a2d0-507a4dcf35ee tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:29.356412 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-348cf442-ce1c-4d17-a2d0-507a4dcf35ee tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:29.367239 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-348cf442-ce1c-4d17-a2d0-507a4dcf35ee tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1523 microversion: 2.1 time: 0.199251 Jun 23 22:37:29.368529 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 99/193] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:29 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:30.163517 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-3768be8a-f520-4c39-9dca-68e9c76debb9 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:30.164126 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-3768be8a-f520-4c39-9dca-68e9c76debb9 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: b98e3e93-9c53-4ff5-8a14-b0cf0a030c72] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:30.171361 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3768be8a-f520-4c39-9dca-68e9c76debb9 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:30.171803 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3768be8a-f520-4c39-9dca-68e9c76debb9 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:30.172582 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3768be8a-f520-4c39-9dca-68e9c76debb9 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:30.173003 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3768be8a-f520-4c39-9dca-68e9c76debb9 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:30.370361 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-3768be8a-f520-4c39-9dca-68e9c76debb9 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:30.381556 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-3768be8a-f520-4c39-9dca-68e9c76debb9 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72" status: 200 len: 1313 microversion: 2.1 time: 0.223309 Jun 23 22:37:30.382264 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 95/194] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:30 2022] GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:30.389461 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-451f61d3-048d-4afe-8a3e-519eb8de32d8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:30.390678 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-451f61d3-048d-4afe-8a3e-519eb8de32d8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:30.396884 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-451f61d3-048d-4afe-8a3e-519eb8de32d8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:30.397515 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-451f61d3-048d-4afe-8a3e-519eb8de32d8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:30.398598 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-451f61d3-048d-4afe-8a3e-519eb8de32d8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:30.398863 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-451f61d3-048d-4afe-8a3e-519eb8de32d8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:30.563113 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-451f61d3-048d-4afe-8a3e-519eb8de32d8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:30.573129 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-451f61d3-048d-4afe-8a3e-519eb8de32d8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1523 microversion: 2.1 time: 0.191068 Jun 23 22:37:30.584774 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 100/195] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:30 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:31.399568 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-8fc6c4fa-c9b5-4916-be54-d5b89d82722c tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:31.400178 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-8fc6c4fa-c9b5-4916-be54-d5b89d82722c tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: b98e3e93-9c53-4ff5-8a14-b0cf0a030c72] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:31.407111 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8fc6c4fa-c9b5-4916-be54-d5b89d82722c tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:31.407548 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8fc6c4fa-c9b5-4916-be54-d5b89d82722c tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:31.408387 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8fc6c4fa-c9b5-4916-be54-d5b89d82722c tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:31.408723 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8fc6c4fa-c9b5-4916-be54-d5b89d82722c tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:31.570896 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-8fc6c4fa-c9b5-4916-be54-d5b89d82722c tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:31.579342 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-8fc6c4fa-c9b5-4916-be54-d5b89d82722c tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72" status: 200 len: 1313 microversion: 2.1 time: 0.183503 Jun 23 22:37:31.579907 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 96/196] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:31 2022] GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:31.596286 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-1cb1e457-3b88-49b9-9921-aa923d0dfbd7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:31.597075 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-1cb1e457-3b88-49b9-9921-aa923d0dfbd7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:31.603148 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1cb1e457-3b88-49b9-9921-aa923d0dfbd7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:31.603591 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1cb1e457-3b88-49b9-9921-aa923d0dfbd7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:31.604349 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1cb1e457-3b88-49b9-9921-aa923d0dfbd7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:31.604776 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1cb1e457-3b88-49b9-9921-aa923d0dfbd7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:31.767638 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-1cb1e457-3b88-49b9-9921-aa923d0dfbd7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:31.775106 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-1cb1e457-3b88-49b9-9921-aa923d0dfbd7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1523 microversion: 2.1 time: 0.183753 Jun 23 22:37:31.775775 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 101/197] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:31 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:32.598543 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-0e010255-e6a8-4cef-b09d-a2dc50699b26 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:32.599830 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-0e010255-e6a8-4cef-b09d-a2dc50699b26 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: b98e3e93-9c53-4ff5-8a14-b0cf0a030c72] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:32.606174 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0e010255-e6a8-4cef-b09d-a2dc50699b26 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:32.606711 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0e010255-e6a8-4cef-b09d-a2dc50699b26 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:32.607405 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0e010255-e6a8-4cef-b09d-a2dc50699b26 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:32.608032 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0e010255-e6a8-4cef-b09d-a2dc50699b26 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:32.759790 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-0e010255-e6a8-4cef-b09d-a2dc50699b26 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:32.771189 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-0e010255-e6a8-4cef-b09d-a2dc50699b26 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72" status: 200 len: 1313 microversion: 2.1 time: 0.175412 Jun 23 22:37:32.772255 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 97/198] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:32 2022] GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:32.792247 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-3707170d-5b87-44cf-a48d-74be5d2bb976 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:32.792857 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-3707170d-5b87-44cf-a48d-74be5d2bb976 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:32.799281 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3707170d-5b87-44cf-a48d-74be5d2bb976 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:32.799724 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3707170d-5b87-44cf-a48d-74be5d2bb976 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:32.800472 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3707170d-5b87-44cf-a48d-74be5d2bb976 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:32.800897 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3707170d-5b87-44cf-a48d-74be5d2bb976 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:32.943261 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-3707170d-5b87-44cf-a48d-74be5d2bb976 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:32.945633 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell1:SELECT=100 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:37:32.952847 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-3707170d-5b87-44cf-a48d-74be5d2bb976 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1523 microversion: 2.1 time: 0.164297 Jun 23 22:37:32.953679 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 102/199] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:32 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:33.254872 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-b5b7e88f-8f98-4b1b-a5c5-551487895110 req-845795d4-78c9-4ba4-b59c-4526f1d8f480 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b98e3e93-9c53-4ff5-8a14-b0cf0a030c72", "name": "network-vif-plugged", "status": "completed", "tag": "d186a1fc-d1bb-4e7e-bf24-f8735a9f9358"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:37:33.266135 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-b5b7e88f-8f98-4b1b-a5c5-551487895110 req-845795d4-78c9-4ba4-b59c-4526f1d8f480 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:33.266676 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-b5b7e88f-8f98-4b1b-a5c5-551487895110 req-845795d4-78c9-4ba4-b59c-4526f1d8f480 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:33.280346 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-b5b7e88f-8f98-4b1b-a5c5-551487895110 req-845795d4-78c9-4ba4-b59c-4526f1d8f480 service nova] Creating event network-vif-plugged:d186a1fc-d1bb-4e7e-bf24-f8735a9f9358 for instance b98e3e93-9c53-4ff5-8a14-b0cf0a030c72 on hv-cinder-84617 Jun 23 22:37:33.285875 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-b5b7e88f-8f98-4b1b-a5c5-551487895110 req-845795d4-78c9-4ba4-b59c-4526f1d8f480 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034719 Jun 23 22:37:33.286831 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 98/200] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:37:33.789740 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-9cce2578-d4e7-48ac-90fc-e19e1363b81e tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:33.790337 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-9cce2578-d4e7-48ac-90fc-e19e1363b81e tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: b98e3e93-9c53-4ff5-8a14-b0cf0a030c72] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:33.797732 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9cce2578-d4e7-48ac-90fc-e19e1363b81e tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:33.799165 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9cce2578-d4e7-48ac-90fc-e19e1363b81e tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:33.800115 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9cce2578-d4e7-48ac-90fc-e19e1363b81e tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:33.800652 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9cce2578-d4e7-48ac-90fc-e19e1363b81e tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:33.956091 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-9cce2578-d4e7-48ac-90fc-e19e1363b81e tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:33.963718 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-9cce2578-d4e7-48ac-90fc-e19e1363b81e tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72" status: 200 len: 1313 microversion: 2.1 time: 0.177922 Jun 23 22:37:33.964288 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 103/201] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:33 2022] GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:33.973430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-28b656c5-ae95-46ac-8945-0ce4507383a4 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:33.974271 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-28b656c5-ae95-46ac-8945-0ce4507383a4 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:33.984118 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-28b656c5-ae95-46ac-8945-0ce4507383a4 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:33.984654 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-28b656c5-ae95-46ac-8945-0ce4507383a4 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:33.985494 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-28b656c5-ae95-46ac-8945-0ce4507383a4 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:33.986020 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-28b656c5-ae95-46ac-8945-0ce4507383a4 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:34.204026 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-28b656c5-ae95-46ac-8945-0ce4507383a4 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:34.212334 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-28b656c5-ae95-46ac-8945-0ce4507383a4 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1523 microversion: 2.1 time: 0.245712 Jun 23 22:37:34.213038 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 99/202] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:33 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1523 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:37:34.982632 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-5f40d52d-3483-4893-80b7-6bb2fff4d218 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:34.982632 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-5f40d52d-3483-4893-80b7-6bb2fff4d218 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: b98e3e93-9c53-4ff5-8a14-b0cf0a030c72] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:34.988635 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5f40d52d-3483-4893-80b7-6bb2fff4d218 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:34.989077 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5f40d52d-3483-4893-80b7-6bb2fff4d218 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:34.989841 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5f40d52d-3483-4893-80b7-6bb2fff4d218 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:34.990267 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5f40d52d-3483-4893-80b7-6bb2fff4d218 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:35.123844 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-5f40d52d-3483-4893-80b7-6bb2fff4d218 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:35.132857 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-5f40d52d-3483-4893-80b7-6bb2fff4d218 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72" status: 200 len: 1313 microversion: 2.1 time: 0.156546 Jun 23 22:37:35.133636 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 104/203] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:34 2022] GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:35.229868 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-757b5b80-d64f-486f-a11d-d9fcfa7a7f34 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:35.230502 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-757b5b80-d64f-486f-a11d-d9fcfa7a7f34 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:35.243420 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-757b5b80-d64f-486f-a11d-d9fcfa7a7f34 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:35.244241 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-757b5b80-d64f-486f-a11d-d9fcfa7a7f34 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:35.245609 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-757b5b80-d64f-486f-a11d-d9fcfa7a7f34 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:35.246193 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-757b5b80-d64f-486f-a11d-d9fcfa7a7f34 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:35.411093 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-757b5b80-d64f-486f-a11d-d9fcfa7a7f34 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:35.419947 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-757b5b80-d64f-486f-a11d-d9fcfa7a7f34 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1523 microversion: 2.1 time: 0.193768 Jun 23 22:37:35.420799 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 100/204] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:35 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:36.151382 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-aa8557fe-b236-4d19-99fc-181110b1d80c tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:36.151941 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-aa8557fe-b236-4d19-99fc-181110b1d80c tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: b98e3e93-9c53-4ff5-8a14-b0cf0a030c72] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:36.158377 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-aa8557fe-b236-4d19-99fc-181110b1d80c tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:36.158818 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-aa8557fe-b236-4d19-99fc-181110b1d80c tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:36.159884 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-aa8557fe-b236-4d19-99fc-181110b1d80c tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:36.160319 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-aa8557fe-b236-4d19-99fc-181110b1d80c tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:36.290099 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-aa8557fe-b236-4d19-99fc-181110b1d80c tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:36.298148 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-aa8557fe-b236-4d19-99fc-181110b1d80c tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72" status: 200 len: 1497 microversion: 2.1 time: 0.150886 Jun 23 22:37:36.298711 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 105/205] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:36 2022] GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72 => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:36.438270 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-405cfdf2-572d-4e75-81f4-f6f9b7e595b9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:36.438913 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-405cfdf2-572d-4e75-81f4-f6f9b7e595b9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:36.445572 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-405cfdf2-572d-4e75-81f4-f6f9b7e595b9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:36.446055 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-405cfdf2-572d-4e75-81f4-f6f9b7e595b9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:36.446896 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-405cfdf2-572d-4e75-81f4-f6f9b7e595b9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:36.447357 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-405cfdf2-572d-4e75-81f4-f6f9b7e595b9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:36.588956 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-405cfdf2-572d-4e75-81f4-f6f9b7e595b9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:36.597409 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-405cfdf2-572d-4e75-81f4-f6f9b7e595b9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1523 microversion: 2.1 time: 0.163903 Jun 23 22:37:36.597996 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 101/206] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:36 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:36.784550 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-056e302f-0743-4f35-b24a-45d5b274f479 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:36.785071 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-056e302f-0743-4f35-b24a-45d5b274f479 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: b98e3e93-9c53-4ff5-8a14-b0cf0a030c72] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:36.791194 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-056e302f-0743-4f35-b24a-45d5b274f479 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:36.791641 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-056e302f-0743-4f35-b24a-45d5b274f479 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:36.792527 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-056e302f-0743-4f35-b24a-45d5b274f479 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:36.792976 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-056e302f-0743-4f35-b24a-45d5b274f479 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:36.831241 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-056e302f-0743-4f35-b24a-45d5b274f479 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: b98e3e93-9c53-4ff5-8a14-b0cf0a030c72] Going to try to terminate instance {{(pid=124357) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:37:36.915979 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-056e302f-0743-4f35-b24a-45d5b274f479 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72" status: 204 len: 0 microversion: 2.1 time: 0.138797 Jun 23 22:37:36.916748 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 106/207] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 23 22:37:36 2022] DELETE /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 22:37:36.925933 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-78fe3870-f931-426c-a7b9-d24102d9ac58 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:36.926619 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-78fe3870-f931-426c-a7b9-d24102d9ac58 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: b98e3e93-9c53-4ff5-8a14-b0cf0a030c72] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:36.936161 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-78fe3870-f931-426c-a7b9-d24102d9ac58 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:36.936622 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-78fe3870-f931-426c-a7b9-d24102d9ac58 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:36.937405 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-78fe3870-f931-426c-a7b9-d24102d9ac58 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:36.937879 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-78fe3870-f931-426c-a7b9-d24102d9ac58 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:37.083031 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-78fe3870-f931-426c-a7b9-d24102d9ac58 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:37.091448 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-78fe3870-f931-426c-a7b9-d24102d9ac58 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72" status: 200 len: 1503 microversion: 2.1 time: 0.168947 Jun 23 22:37:37.092135 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 102/208] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:36 2022] GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72 => generated 1503 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:37.615781 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-7736461c-65cd-4306-939b-322901e5ae48 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:37.617099 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-7736461c-65cd-4306-939b-322901e5ae48 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:37.624470 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7736461c-65cd-4306-939b-322901e5ae48 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:37.625018 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7736461c-65cd-4306-939b-322901e5ae48 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:37.625897 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7736461c-65cd-4306-939b-322901e5ae48 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:37.626429 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7736461c-65cd-4306-939b-322901e5ae48 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:37.796889 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-7736461c-65cd-4306-939b-322901e5ae48 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:37.808609 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-7736461c-65cd-4306-939b-322901e5ae48 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1523 microversion: 2.1 time: 0.196061 Jun 23 22:37:37.812319 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 107/209] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:37 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:38.109415 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-5028e90d-012a-46dc-a919-d1a345ef3ea9 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:38.110069 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-5028e90d-012a-46dc-a919-d1a345ef3ea9 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: b98e3e93-9c53-4ff5-8a14-b0cf0a030c72] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:38.118321 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5028e90d-012a-46dc-a919-d1a345ef3ea9 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:38.119080 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5028e90d-012a-46dc-a919-d1a345ef3ea9 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:38.119855 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5028e90d-012a-46dc-a919-d1a345ef3ea9 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:38.120334 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5028e90d-012a-46dc-a919-d1a345ef3ea9 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:38.303423 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-5028e90d-012a-46dc-a919-d1a345ef3ea9 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:38.307275 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=100 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:37:38.312951 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-5028e90d-012a-46dc-a919-d1a345ef3ea9 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72" status: 200 len: 1503 microversion: 2.1 time: 0.207955 Jun 23 22:37:38.313687 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 103/210] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:38 2022] GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72 => generated 1503 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:38.828063 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-18cb8a31-3e24-4127-9726-255b7f8571f8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:38.829259 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-18cb8a31-3e24-4127-9726-255b7f8571f8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:38.835646 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-18cb8a31-3e24-4127-9726-255b7f8571f8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:38.836331 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-18cb8a31-3e24-4127-9726-255b7f8571f8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:38.837361 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-18cb8a31-3e24-4127-9726-255b7f8571f8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:38.838059 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-18cb8a31-3e24-4127-9726-255b7f8571f8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:39.083136 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-18cb8a31-3e24-4127-9726-255b7f8571f8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:39.094457 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-18cb8a31-3e24-4127-9726-255b7f8571f8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1523 microversion: 2.1 time: 0.270233 Jun 23 22:37:39.095152 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 108/211] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:38 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1523 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:39.330165 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d3a80dba-56f6-4e4f-892a-0c4fa1053268 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:39.333083 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-d3a80dba-56f6-4e4f-892a-0c4fa1053268 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: b98e3e93-9c53-4ff5-8a14-b0cf0a030c72] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:39.344232 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d3a80dba-56f6-4e4f-892a-0c4fa1053268 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:39.347027 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d3a80dba-56f6-4e4f-892a-0c4fa1053268 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:39.348619 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d3a80dba-56f6-4e4f-892a-0c4fa1053268 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:39.349070 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d3a80dba-56f6-4e4f-892a-0c4fa1053268 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:39.489957 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d3a80dba-56f6-4e4f-892a-0c4fa1053268 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:39.503029 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d3a80dba-56f6-4e4f-892a-0c4fa1053268 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72" status: 200 len: 1461 microversion: 2.1 time: 0.176710 Jun 23 22:37:39.504803 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 104/212] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:39 2022] GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72 => generated 1461 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:39.509532 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [req-4eb7a8ed-39f9-4701-aafa-d904296627c8 req-7d6e6fb3-bd90-4093-8e61-d07931496b1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b98e3e93-9c53-4ff5-8a14-b0cf0a030c72", "name": "network-vif-deleted", "tag": "d186a1fc-d1bb-4e7e-bf24-f8735a9f9358"}]} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:37:39.524740 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-4eb7a8ed-39f9-4701-aafa-d904296627c8 req-7d6e6fb3-bd90-4093-8e61-d07931496b1b service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:39.525185 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-4eb7a8ed-39f9-4701-aafa-d904296627c8 req-7d6e6fb3-bd90-4093-8e61-d07931496b1b service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:39.536794 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.compute.server_external_events [req-4eb7a8ed-39f9-4701-aafa-d904296627c8 req-7d6e6fb3-bd90-4093-8e61-d07931496b1b service nova] Creating event network-vif-deleted:d186a1fc-d1bb-4e7e-bf24-f8735a9f9358 for instance b98e3e93-9c53-4ff5-8a14-b0cf0a030c72 on hv-cinder-84617 Jun 23 22:37:39.541831 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [req-4eb7a8ed-39f9-4701-aafa-d904296627c8 req-7d6e6fb3-bd90-4093-8e61-d07931496b1b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036268 Jun 23 22:37:39.542497 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 109/213] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:37:40.115542 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d7275e7b-cf5c-4d4a-b58b-2ee81b2fa933 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:40.120875 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-d7275e7b-cf5c-4d4a-b58b-2ee81b2fa933 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:40.133815 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d7275e7b-cf5c-4d4a-b58b-2ee81b2fa933 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:40.134653 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d7275e7b-cf5c-4d4a-b58b-2ee81b2fa933 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:40.156213 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d7275e7b-cf5c-4d4a-b58b-2ee81b2fa933 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:40.156837 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d7275e7b-cf5c-4d4a-b58b-2ee81b2fa933 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:40.382222 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d7275e7b-cf5c-4d4a-b58b-2ee81b2fa933 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:40.392660 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d7275e7b-cf5c-4d4a-b58b-2ee81b2fa933 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1523 microversion: 2.1 time: 0.284082 Jun 23 22:37:40.393873 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 105/214] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:40 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1523 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:40.525503 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-3264a2e0-f97c-442c-b24b-1444051fd18c tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:40.525503 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-3264a2e0-f97c-442c-b24b-1444051fd18c tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: b98e3e93-9c53-4ff5-8a14-b0cf0a030c72] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:40.533196 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3264a2e0-f97c-442c-b24b-1444051fd18c tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:40.533813 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3264a2e0-f97c-442c-b24b-1444051fd18c tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:40.535350 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3264a2e0-f97c-442c-b24b-1444051fd18c tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:40.535980 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3264a2e0-f97c-442c-b24b-1444051fd18c tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:40.576587 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3264a2e0-f97c-442c-b24b-1444051fd18c tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:40.577246 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3264a2e0-f97c-442c-b24b-1444051fd18c tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:40.591343 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.objects.instance [None req-3264a2e0-f97c-442c-b24b-1444051fd18c tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lazy-loading 'fault' on Instance uuid b98e3e93-9c53-4ff5-8a14-b0cf0a030c72 {{(pid=124357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:37:40.647141 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-3264a2e0-f97c-442c-b24b-1444051fd18c tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:40.654897 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-3264a2e0-f97c-442c-b24b-1444051fd18c tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72" status: 200 len: 1303 microversion: 2.1 time: 0.134280 Jun 23 22:37:40.655509 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 110/215] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:40 2022] GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72 => generated 1303 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:41.412344 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c797e3b3-c454-4e72-9ab3-d9760168584f tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:41.412878 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c797e3b3-c454-4e72-9ab3-d9760168584f tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:41.415215 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=76 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:37:41.421543 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c797e3b3-c454-4e72-9ab3-d9760168584f tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:41.421992 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c797e3b3-c454-4e72-9ab3-d9760168584f tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:41.424146 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c797e3b3-c454-4e72-9ab3-d9760168584f tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:41.424588 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c797e3b3-c454-4e72-9ab3-d9760168584f tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:41.562481 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c797e3b3-c454-4e72-9ab3-d9760168584f tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:41.570016 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c797e3b3-c454-4e72-9ab3-d9760168584f tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1523 microversion: 2.1 time: 0.161908 Jun 23 22:37:41.570598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 106/216] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:41 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:41.674060 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-7024553f-1d9d-449d-8a88-ad9e977ab7e2 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:41.674670 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-7024553f-1d9d-449d-8a88-ad9e977ab7e2 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: b98e3e93-9c53-4ff5-8a14-b0cf0a030c72] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:41.680869 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7024553f-1d9d-449d-8a88-ad9e977ab7e2 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:41.681316 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7024553f-1d9d-449d-8a88-ad9e977ab7e2 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:41.682084 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7024553f-1d9d-449d-8a88-ad9e977ab7e2 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:41.682514 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7024553f-1d9d-449d-8a88-ad9e977ab7e2 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:41.698018 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.wsgi [None req-7024553f-1d9d-449d-8a88-ad9e977ab7e2 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] HTTP exception thrown: Instance b98e3e93-9c53-4ff5-8a14-b0cf0a030c72 could not be found. Jun 23 22:37:41.703766 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-7024553f-1d9d-449d-8a88-ad9e977ab7e2 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Request method failure captured: Jun 23 22:37:41.703766 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: request: GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72 HTTP/1.1 Jun 23 22:37:41.703766 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept: application/json Jun 23 22:37:41.703766 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept-Encoding: identity Jun 23 22:37:41.703766 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Connection: close Jun 23 22:37:41.703766 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Length: 0 Jun 23 22:37:41.703766 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Type: application/json Jun 23 22:37:41.703766 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Host: 10.222.0.43 Jun 23 22:37:41.703766 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Openstack-System-Scope: None Jun 23 22:37:41.703766 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: User-Agent: python-urllib3/1.26.9 Jun 23 22:37:41.703766 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Auth-Token: gAAAAABitOsU28Kr0yxkV7ELEBWMksx4PG6BmH5VZojU5TBQaS4FVi-c_FtuE_1JkRqbb-ityjk9tl7Ju0X9YXO0RWmGFDxnu6Di5xbF7uCHldhIKeJgT0lTfHmq6ZEZka8DgSe9NM-prv2ij5rBcByShgS27NL0P2UfwFmkYcYww8H-i0HaXKY Jun 23 22:37:41.703766 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Id: None Jun 23 22:37:41.703766 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Name: None Jun 23 22:37:41.703766 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Identity-Status: Confirmed Jun 23 22:37:41.703766 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Is-Admin-Project: True Jun 23 22:37:41.703766 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Id: default Jun 23 22:37:41.703766 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Name: Default Jun 23 22:37:41.703766 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Id: e4fb6c541ee04ebea81001c24c67d779 Jun 23 22:37:41.703766 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Name: tempest-VolumesActionsTest-2082090692 Jun 23 22:37:41.703766 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Role: reader,member Jun 23 22:37:41.703766 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Roles: reader,member Jun 23 22:37:41.705347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e4fb6c541ee04ebea81001c24c67d779"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e4fb6c541ee04ebea81001c24c67d779"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e4fb6c541ee04ebea81001c24c67d779", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e4fb6c541ee04ebea81001c24c67d779"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:37:41.705347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant: tempest-VolumesActionsTest-2082090692 Jun 23 22:37:41.705347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Id: e4fb6c541ee04ebea81001c24c67d779 Jun 23 22:37:41.705347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Name: tempest-VolumesActionsTest-2082090692 Jun 23 22:37:41.705347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User: tempest-VolumesActionsTest-2082090692-project Jun 23 22:37:41.705347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Id: default Jun 23 22:37:41.705347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Name: Default Jun 23 22:37:41.705347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Id: bbe630f5c7c243588c5bd33023775d69 Jun 23 22:37:41.705347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Name: tempest-VolumesActionsTest-2082090692-project Jun 23 22:37:41.705347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: method: > Jun 23 22:37:41.705347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: exception: Instance b98e3e93-9c53-4ff5-8a14-b0cf0a030c72 could not be found. Jun 23 22:37:41.705347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: action_args: {'id': 'b98e3e93-9c53-4ff5-8a14-b0cf0a030c72'} Jun 23 22:37:41.706127 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:37:41.706127 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:37:41.706127 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:37:41.706127 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:37:41.706127 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:37:41.706127 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:37:41.706127 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:37:41.706127 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:37:41.706127 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:37:41.706127 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:37:41.706127 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b98e3e93-9c53-4ff5-8a14-b0cf0a030c72 could not be found. Jun 23 22:37:41.706127 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:37:41.706127 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:37:41.706127 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:37:41.706127 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:37:41.706127 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:37:41.706127 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:37:41.706127 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:37:41.706127 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:37:41.706127 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:37:41.707534 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:37:41.707534 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:37:41.707534 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:37:41.707534 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:37:41.707534 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:37:41.707534 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:37:41.707534 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:37:41.707534 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b98e3e93-9c53-4ff5-8a14-b0cf0a030c72 could not be found. Jun 23 22:37:41.707534 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:37:41.707534 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:37:41.707534 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:37:41.707534 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:37:41.707534 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:37:41.707534 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:37:41.707534 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:37:41.707534 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:37:41.707534 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b98e3e93-9c53-4ff5-8a14-b0cf0a030c72 could not be found. Jun 23 22:37:41.707534 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:37:41.708767 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-7024553f-1d9d-449d-8a88-ad9e977ab7e2 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Returning 404 to user: Instance b98e3e93-9c53-4ff5-8a14-b0cf0a030c72 could not be found. {{(pid=124357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:37:41.708767 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-7024553f-1d9d-449d-8a88-ad9e977ab7e2 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72" status: 404 len: 111 microversion: 2.1 time: 0.035121 Jun 23 22:37:41.708767 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 111/217] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:41 2022] GET /compute/v2.1/servers/b98e3e93-9c53-4ff5-8a14-b0cf0a030c72 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 22:37:41.817390 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-0b89ec36-d6e8-40e2-b52c-e613224edc3f tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-234527295", "imageRef": "ac7d441e-2ac8-49ad-9dc5-3c55bd4b4f8b", "flavorRef": "452", "networks": [{"uuid": "37e85836-e932-474e-813c-5279946996b9"}]}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:37:41.876623 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.network.neutron [None req-0b89ec36-d6e8-40e2-b52c-e613224edc3f tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] validate_networks() for [('37e85836-e932-474e-813c-5279946996b9', None, None, None, None, None)] {{(pid=124358) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:37:42.297889 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-0b89ec36-d6e8-40e2-b52c-e613224edc3f tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Flavor limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:37:42.298302 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-0b89ec36-d6e8-40e2-b52c-e613224edc3f tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Image limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:37:42.298768 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-0b89ec36-d6e8-40e2-b52c-e613224edc3f tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Flavor pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:37:42.299211 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-0b89ec36-d6e8-40e2-b52c-e613224edc3f tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Image pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:37:42.299614 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-0b89ec36-d6e8-40e2-b52c-e613224edc3f tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:37:42.309729 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0b89ec36-d6e8-40e2-b52c-e613224edc3f tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:42.310161 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0b89ec36-d6e8-40e2-b52c-e613224edc3f tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:42.311212 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0b89ec36-d6e8-40e2-b52c-e613224edc3f tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:42.311660 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0b89ec36-d6e8-40e2-b52c-e613224edc3f tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:42.328757 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-0b89ec36-d6e8-40e2-b52c-e613224edc3f tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Getting quotas for project e4fb6c541ee04ebea81001c24c67d779. Resources: {'instances', 'cores', 'ram'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:37:42.332692 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-0b89ec36-d6e8-40e2-b52c-e613224edc3f tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Getting quotas for user bbe630f5c7c243588c5bd33023775d69 and project e4fb6c541ee04ebea81001c24c67d779. Resources: {'instances', 'cores', 'ram'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:37:42.345132 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-0b89ec36-d6e8-40e2-b52c-e613224edc3f tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Going to run 1 instances... {{(pid=124358) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:37:42.347403 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-0b89ec36-d6e8-40e2-b52c-e613224edc3f tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: 006762e8-f0b5-4be1-b4b3-cd620638df23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ac7d441e-2ac8-49ad-9dc5-3c55bd4b4f8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:37:42.395120 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-0b89ec36-d6e8-40e2-b52c-e613224edc3f tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.581374 Jun 23 22:37:42.396137 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 107/218] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Jun 23 22:37:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 22:37:42.407682 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-a24dcdfb-e288-4eb5-aa67-16fa33e39d27 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:42.408431 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-a24dcdfb-e288-4eb5-aa67-16fa33e39d27 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: 006762e8-f0b5-4be1-b4b3-cd620638df23] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:42.463501 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-a24dcdfb-e288-4eb5-aa67-16fa33e39d27 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:42.470693 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-a24dcdfb-e288-4eb5-aa67-16fa33e39d27 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/006762e8-f0b5-4be1-b4b3-cd620638df23" status: 200 len: 1213 microversion: 2.1 time: 0.068520 Jun 23 22:37:42.471299 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 112/219] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:42 2022] GET /compute/v2.1/servers/006762e8-f0b5-4be1-b4b3-cd620638df23 => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:42.588471 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-afc4270e-1968-4f6c-a399-2abe1e75e2f0 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:42.589095 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-afc4270e-1968-4f6c-a399-2abe1e75e2f0 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:42.595685 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-afc4270e-1968-4f6c-a399-2abe1e75e2f0 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:42.596169 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-afc4270e-1968-4f6c-a399-2abe1e75e2f0 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:42.596908 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-afc4270e-1968-4f6c-a399-2abe1e75e2f0 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:42.597339 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-afc4270e-1968-4f6c-a399-2abe1e75e2f0 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:42.748078 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-afc4270e-1968-4f6c-a399-2abe1e75e2f0 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:42.755751 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-afc4270e-1968-4f6c-a399-2abe1e75e2f0 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1523 microversion: 2.1 time: 0.171546 Jun 23 22:37:42.756294 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 108/220] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:42 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:43.488307 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-fcb1d77e-591d-4f2f-8d9e-e570424d1a2e tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:43.488823 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-fcb1d77e-591d-4f2f-8d9e-e570424d1a2e tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: 006762e8-f0b5-4be1-b4b3-cd620638df23] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:43.498750 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fcb1d77e-591d-4f2f-8d9e-e570424d1a2e tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:43.499221 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fcb1d77e-591d-4f2f-8d9e-e570424d1a2e tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:43.500218 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fcb1d77e-591d-4f2f-8d9e-e570424d1a2e tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:43.500649 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fcb1d77e-591d-4f2f-8d9e-e570424d1a2e tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:43.568936 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-fcb1d77e-591d-4f2f-8d9e-e570424d1a2e tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:43.577721 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-fcb1d77e-591d-4f2f-8d9e-e570424d1a2e tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/006762e8-f0b5-4be1-b4b3-cd620638df23" status: 200 len: 1217 microversion: 2.1 time: 0.093495 Jun 23 22:37:43.578515 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 113/221] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:43 2022] GET /compute/v2.1/servers/006762e8-f0b5-4be1-b4b3-cd620638df23 => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:43.773615 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-ef0d5293-5be9-49fd-acb7-d249735d43f9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:43.774409 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-ef0d5293-5be9-49fd-acb7-d249735d43f9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:43.780876 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ef0d5293-5be9-49fd-acb7-d249735d43f9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:43.781313 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ef0d5293-5be9-49fd-acb7-d249735d43f9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:43.782099 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ef0d5293-5be9-49fd-acb7-d249735d43f9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:43.782521 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ef0d5293-5be9-49fd-acb7-d249735d43f9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:43.932960 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ef0d5293-5be9-49fd-acb7-d249735d43f9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:43.943322 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-ef0d5293-5be9-49fd-acb7-d249735d43f9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1523 microversion: 2.1 time: 0.173496 Jun 23 22:37:43.944037 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 109/222] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:43 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:44.594836 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-99751990-197b-490a-ad74-7e1092bd442c tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:44.595601 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-99751990-197b-490a-ad74-7e1092bd442c tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: 006762e8-f0b5-4be1-b4b3-cd620638df23] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:44.602437 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-99751990-197b-490a-ad74-7e1092bd442c tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:44.602953 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-99751990-197b-490a-ad74-7e1092bd442c tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:44.603954 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-99751990-197b-490a-ad74-7e1092bd442c tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:44.604391 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-99751990-197b-490a-ad74-7e1092bd442c tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:44.668887 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-99751990-197b-490a-ad74-7e1092bd442c tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:44.676439 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-99751990-197b-490a-ad74-7e1092bd442c tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/006762e8-f0b5-4be1-b4b3-cd620638df23" status: 200 len: 1265 microversion: 2.1 time: 0.085436 Jun 23 22:37:44.681672 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 114/223] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:44 2022] GET /compute/v2.1/servers/006762e8-f0b5-4be1-b4b3-cd620638df23 => generated 1265 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:44.961471 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-0c8fe9d2-9448-432d-9e9f-c41ea13739cd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:44.962627 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-0c8fe9d2-9448-432d-9e9f-c41ea13739cd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:44.970786 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0c8fe9d2-9448-432d-9e9f-c41ea13739cd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:44.971390 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0c8fe9d2-9448-432d-9e9f-c41ea13739cd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:44.972403 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0c8fe9d2-9448-432d-9e9f-c41ea13739cd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:44.972785 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0c8fe9d2-9448-432d-9e9f-c41ea13739cd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:45.134409 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-0c8fe9d2-9448-432d-9e9f-c41ea13739cd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:45.143053 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-0c8fe9d2-9448-432d-9e9f-c41ea13739cd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1503 microversion: 2.1 time: 0.185910 Jun 23 22:37:45.143626 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 110/224] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:44 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1503 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:45.159592 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-0992596e-8b68-4899-af24-d07b58b08c3a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:45.160312 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-0992596e-8b68-4899-af24-d07b58b08c3a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:45.167201 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-0992596e-8b68-4899-af24-d07b58b08c3a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:45.167652 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-0992596e-8b68-4899-af24-d07b58b08c3a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:45.169002 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-0992596e-8b68-4899-af24-d07b58b08c3a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:45.169401 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-0992596e-8b68-4899-af24-d07b58b08c3a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:45.308302 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-0992596e-8b68-4899-af24-d07b58b08c3a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:45.315977 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-0992596e-8b68-4899-af24-d07b58b08c3a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4" status: 200 len: 1516 microversion: 2.1 time: 0.160753 Jun 23 22:37:45.316549 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 115/225] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:45 2022] GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:45.695277 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-663e9db8-d610-4e9f-a3cc-8a5d0b45752d tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:45.696000 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-663e9db8-d610-4e9f-a3cc-8a5d0b45752d tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: 006762e8-f0b5-4be1-b4b3-cd620638df23] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:45.710510 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-663e9db8-d610-4e9f-a3cc-8a5d0b45752d tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:45.711084 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-663e9db8-d610-4e9f-a3cc-8a5d0b45752d tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:45.713018 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-663e9db8-d610-4e9f-a3cc-8a5d0b45752d tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:45.716173 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-663e9db8-d610-4e9f-a3cc-8a5d0b45752d tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:45.812218 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-663e9db8-d610-4e9f-a3cc-8a5d0b45752d tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:45.819997 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-663e9db8-d610-4e9f-a3cc-8a5d0b45752d tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/006762e8-f0b5-4be1-b4b3-cd620638df23" status: 200 len: 1283 microversion: 2.1 time: 0.130421 Jun 23 22:37:45.830507 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 111/226] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:45 2022] GET /compute/v2.1/servers/006762e8-f0b5-4be1-b4b3-cd620638df23 => generated 1283 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:46.761357 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-20ef83c9-a6cc-4c6c-81be-e2f65a63d669 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:37:46.763043 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-20ef83c9-a6cc-4c6c-81be-e2f65a63d669 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:46.769365 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-20ef83c9-a6cc-4c6c-81be-e2f65a63d669 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:46.769905 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-20ef83c9-a6cc-4c6c-81be-e2f65a63d669 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:46.770770 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-20ef83c9-a6cc-4c6c-81be-e2f65a63d669 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:46.771345 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-20ef83c9-a6cc-4c6c-81be-e2f65a63d669 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:46.796161 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.objects.instance [None req-20ef83c9-a6cc-4c6c-81be-e2f65a63d669 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lazy-loading 'flavor' on Instance uuid 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 {{(pid=124357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:37:46.839095 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-daef3cd1-d7b1-49af-9bfa-7946ae1f7c28 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:46.839694 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-daef3cd1-d7b1-49af-9bfa-7946ae1f7c28 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: 006762e8-f0b5-4be1-b4b3-cd620638df23] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:46.851627 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-daef3cd1-d7b1-49af-9bfa-7946ae1f7c28 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:46.852075 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-daef3cd1-d7b1-49af-9bfa-7946ae1f7c28 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:46.855162 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-daef3cd1-d7b1-49af-9bfa-7946ae1f7c28 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:46.857707 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-daef3cd1-d7b1-49af-9bfa-7946ae1f7c28 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:46.919727 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-20ef83c9-a6cc-4c6c-81be-e2f65a63d669 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "POST /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4/action" status: 200 len: 32 microversion: 2.1 time: 0.162048 Jun 23 22:37:46.920777 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 116/227] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Jun 23 22:37:46 2022] POST /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4/action => generated 32 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 22:37:46.945096 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-669b1276-f44a-4ccb-8a1e-8f4fa87242fa tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:46.945888 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-669b1276-f44a-4ccb-8a1e-8f4fa87242fa tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:46.954038 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-669b1276-f44a-4ccb-8a1e-8f4fa87242fa tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:46.954586 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-669b1276-f44a-4ccb-8a1e-8f4fa87242fa tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:46.955515 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-669b1276-f44a-4ccb-8a1e-8f4fa87242fa tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:46.956042 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-669b1276-f44a-4ccb-8a1e-8f4fa87242fa tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:47.274241 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-daef3cd1-d7b1-49af-9bfa-7946ae1f7c28 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:47.283074 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-daef3cd1-d7b1-49af-9bfa-7946ae1f7c28 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/006762e8-f0b5-4be1-b4b3-cd620638df23" status: 200 len: 1313 microversion: 2.1 time: 0.448906 Jun 23 22:37:47.286949 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 112/228] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:46 2022] GET /compute/v2.1/servers/006762e8-f0b5-4be1-b4b3-cd620638df23 => generated 1313 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:37:47.335564 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-669b1276-f44a-4ccb-8a1e-8f4fa87242fa tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:47.340015 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:37:47.351715 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-669b1276-f44a-4ccb-8a1e-8f4fa87242fa tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4" status: 200 len: 1522 microversion: 2.1 time: 0.411436 Jun 23 22:37:47.366607 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 117/229] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:46 2022] GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 => generated 1522 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:47.501799 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-31a1bb4f-78b1-4527-babb-cd2c11fdb2fe req-71209f94-f56c-47a8-92c8-f789915d21d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "006762e8-f0b5-4be1-b4b3-cd620638df23", "tag": "fcd7f448-0e19-49ef-8647-5eb43ef16709"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:37:47.524862 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-31a1bb4f-78b1-4527-babb-cd2c11fdb2fe req-71209f94-f56c-47a8-92c8-f789915d21d3 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:47.525493 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-31a1bb4f-78b1-4527-babb-cd2c11fdb2fe req-71209f94-f56c-47a8-92c8-f789915d21d3 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:47.541788 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-31a1bb4f-78b1-4527-babb-cd2c11fdb2fe req-71209f94-f56c-47a8-92c8-f789915d21d3 service nova] Creating event network-changed:fcd7f448-0e19-49ef-8647-5eb43ef16709 for instance 006762e8-f0b5-4be1-b4b3-cd620638df23 on hv-cinder-84617 Jun 23 22:37:47.552758 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-31a1bb4f-78b1-4527-babb-cd2c11fdb2fe req-71209f94-f56c-47a8-92c8-f789915d21d3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065351 Jun 23 22:37:47.553607 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 113/230] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:37:48.305110 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-ebe49bf9-13bf-426e-a86c-293331a54ad0 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:48.307186 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-ebe49bf9-13bf-426e-a86c-293331a54ad0 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: 006762e8-f0b5-4be1-b4b3-cd620638df23] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:48.316719 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ebe49bf9-13bf-426e-a86c-293331a54ad0 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:48.317574 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ebe49bf9-13bf-426e-a86c-293331a54ad0 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:48.318837 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ebe49bf9-13bf-426e-a86c-293331a54ad0 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:48.319574 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ebe49bf9-13bf-426e-a86c-293331a54ad0 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:48.375048 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-195a4ab7-fdb8-47a0-a37c-38f101ad190a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:48.375749 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-195a4ab7-fdb8-47a0-a37c-38f101ad190a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:48.383061 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-195a4ab7-fdb8-47a0-a37c-38f101ad190a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:48.383675 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-195a4ab7-fdb8-47a0-a37c-38f101ad190a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:48.384742 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-195a4ab7-fdb8-47a0-a37c-38f101ad190a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:48.385325 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-195a4ab7-fdb8-47a0-a37c-38f101ad190a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:48.517779 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-ebe49bf9-13bf-426e-a86c-293331a54ad0 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:48.525725 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-ebe49bf9-13bf-426e-a86c-293331a54ad0 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/006762e8-f0b5-4be1-b4b3-cd620638df23" status: 200 len: 1313 microversion: 2.1 time: 0.228815 Jun 23 22:37:48.526813 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 118/231] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:48 2022] GET /compute/v2.1/servers/006762e8-f0b5-4be1-b4b3-cd620638df23 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:48.580581 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-195a4ab7-fdb8-47a0-a37c-38f101ad190a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:48.588700 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-195a4ab7-fdb8-47a0-a37c-38f101ad190a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4" status: 200 len: 1522 microversion: 2.1 time: 0.219132 Jun 23 22:37:48.589405 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 114/232] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:48 2022] GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:37:49.544056 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-64f3484f-a443-46a4-9a4d-5e7c35c8006a tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:49.544655 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-64f3484f-a443-46a4-9a4d-5e7c35c8006a tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: 006762e8-f0b5-4be1-b4b3-cd620638df23] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:49.550602 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-64f3484f-a443-46a4-9a4d-5e7c35c8006a tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:49.551070 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-64f3484f-a443-46a4-9a4d-5e7c35c8006a tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:49.551813 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-64f3484f-a443-46a4-9a4d-5e7c35c8006a tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:49.552236 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-64f3484f-a443-46a4-9a4d-5e7c35c8006a tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:49.606787 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-59df9970-f44c-4006-8cc7-c1b251633b6a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:49.607588 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-59df9970-f44c-4006-8cc7-c1b251633b6a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:49.614146 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-59df9970-f44c-4006-8cc7-c1b251633b6a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:49.614665 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-59df9970-f44c-4006-8cc7-c1b251633b6a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:49.615530 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-59df9970-f44c-4006-8cc7-c1b251633b6a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:49.616035 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-59df9970-f44c-4006-8cc7-c1b251633b6a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:49.724247 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-64f3484f-a443-46a4-9a4d-5e7c35c8006a tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:49.732020 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-64f3484f-a443-46a4-9a4d-5e7c35c8006a tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/006762e8-f0b5-4be1-b4b3-cd620638df23" status: 200 len: 1313 microversion: 2.1 time: 0.192380 Jun 23 22:37:49.732597 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 119/233] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:49 2022] GET /compute/v2.1/servers/006762e8-f0b5-4be1-b4b3-cd620638df23 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:49.766539 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-59df9970-f44c-4006-8cc7-c1b251633b6a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:49.774406 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-59df9970-f44c-4006-8cc7-c1b251633b6a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4" status: 200 len: 1522 microversion: 2.1 time: 0.171474 Jun 23 22:37:49.774991 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 115/234] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:49 2022] GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:37:50.749272 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-cb02be19-6a18-4ccc-bad1-25fad6c68168 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:50.749878 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-cb02be19-6a18-4ccc-bad1-25fad6c68168 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: 006762e8-f0b5-4be1-b4b3-cd620638df23] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:50.755861 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-cb02be19-6a18-4ccc-bad1-25fad6c68168 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:50.756295 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-cb02be19-6a18-4ccc-bad1-25fad6c68168 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:50.757038 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-cb02be19-6a18-4ccc-bad1-25fad6c68168 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:50.757456 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-cb02be19-6a18-4ccc-bad1-25fad6c68168 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:50.792644 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-7815547b-b787-4768-b528-150a783a1159 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:50.793848 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-7815547b-b787-4768-b528-150a783a1159 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:50.800527 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7815547b-b787-4768-b528-150a783a1159 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:50.801050 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7815547b-b787-4768-b528-150a783a1159 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:50.801887 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7815547b-b787-4768-b528-150a783a1159 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:50.802389 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7815547b-b787-4768-b528-150a783a1159 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:50.941295 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-cb02be19-6a18-4ccc-bad1-25fad6c68168 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:50.948583 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-cb02be19-6a18-4ccc-bad1-25fad6c68168 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/006762e8-f0b5-4be1-b4b3-cd620638df23" status: 200 len: 1313 microversion: 2.1 time: 0.203781 Jun 23 22:37:50.949146 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 120/235] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:50 2022] GET /compute/v2.1/servers/006762e8-f0b5-4be1-b4b3-cd620638df23 => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:50.968969 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-7815547b-b787-4768-b528-150a783a1159 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:50.976410 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-7815547b-b787-4768-b528-150a783a1159 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4" status: 200 len: 1522 microversion: 2.1 time: 0.187560 Jun 23 22:37:50.976969 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 116/236] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:50 2022] GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:37:51.966392 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-c56f5e85-ef0a-4aa7-a4ee-42be354a98c1 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:51.967118 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-c56f5e85-ef0a-4aa7-a4ee-42be354a98c1 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: 006762e8-f0b5-4be1-b4b3-cd620638df23] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:51.973137 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c56f5e85-ef0a-4aa7-a4ee-42be354a98c1 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:51.973577 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c56f5e85-ef0a-4aa7-a4ee-42be354a98c1 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:51.974344 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c56f5e85-ef0a-4aa7-a4ee-42be354a98c1 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:51.974770 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c56f5e85-ef0a-4aa7-a4ee-42be354a98c1 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:51.993325 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-87a9e9b0-171c-4f49-a531-72937f9b1b17 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:51.994519 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-87a9e9b0-171c-4f49-a531-72937f9b1b17 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:52.001714 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-87a9e9b0-171c-4f49-a531-72937f9b1b17 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:52.002152 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-87a9e9b0-171c-4f49-a531-72937f9b1b17 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:52.002907 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-87a9e9b0-171c-4f49-a531-72937f9b1b17 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:52.003410 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-87a9e9b0-171c-4f49-a531-72937f9b1b17 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:52.175332 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-c56f5e85-ef0a-4aa7-a4ee-42be354a98c1 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:52.185435 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-c56f5e85-ef0a-4aa7-a4ee-42be354a98c1 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/006762e8-f0b5-4be1-b4b3-cd620638df23" status: 200 len: 1313 microversion: 2.1 time: 0.223688 Jun 23 22:37:52.187187 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 121/237] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:51 2022] GET /compute/v2.1/servers/006762e8-f0b5-4be1-b4b3-cd620638df23 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:52.187532 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-87a9e9b0-171c-4f49-a531-72937f9b1b17 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:52.195468 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-87a9e9b0-171c-4f49-a531-72937f9b1b17 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4" status: 200 len: 1522 microversion: 2.1 time: 0.205883 Jun 23 22:37:52.196148 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 117/238] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:51 2022] GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:37:53.202363 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-1c4a805f-99c5-4d37-aca7-c5fa1a9ba95e tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:53.202908 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-1c4a805f-99c5-4d37-aca7-c5fa1a9ba95e tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: 006762e8-f0b5-4be1-b4b3-cd620638df23] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:53.204785 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell0:SELECT=2 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:37:53.210206 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1c4a805f-99c5-4d37-aca7-c5fa1a9ba95e tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:53.210650 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1c4a805f-99c5-4d37-aca7-c5fa1a9ba95e tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:53.211436 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1c4a805f-99c5-4d37-aca7-c5fa1a9ba95e tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:53.211864 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1c4a805f-99c5-4d37-aca7-c5fa1a9ba95e tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:53.213522 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-61338553-02d0-43e4-bde0-0d833342d3fa tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:53.214465 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-61338553-02d0-43e4-bde0-0d833342d3fa tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:53.218200 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=2 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:37:53.218200 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=6 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:37:53.224509 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-61338553-02d0-43e4-bde0-0d833342d3fa tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:53.225019 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-61338553-02d0-43e4-bde0-0d833342d3fa tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:53.225849 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-61338553-02d0-43e4-bde0-0d833342d3fa tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:53.226339 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-61338553-02d0-43e4-bde0-0d833342d3fa tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:53.422529 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-1c4a805f-99c5-4d37-aca7-c5fa1a9ba95e tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:53.425018 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-61338553-02d0-43e4-bde0-0d833342d3fa tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:53.432299 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-1c4a805f-99c5-4d37-aca7-c5fa1a9ba95e tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/006762e8-f0b5-4be1-b4b3-cd620638df23" status: 200 len: 1313 microversion: 2.1 time: 0.233719 Jun 23 22:37:53.432483 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-61338553-02d0-43e4-bde0-0d833342d3fa tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4" status: 200 len: 1522 microversion: 2.1 time: 0.223115 Jun 23 22:37:53.432890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 122/239] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:53 2022] GET /compute/v2.1/servers/006762e8-f0b5-4be1-b4b3-cd620638df23 => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:53.443486 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 118/240] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:53 2022] GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:54.217886 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [req-136559f0-7b73-4aa1-9263-b4856a05e6e7 req-416320b9-c5f8-4e46-9aef-2dc322ddddbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "006762e8-f0b5-4be1-b4b3-cd620638df23", "name": "network-vif-plugged", "status": "completed", "tag": "fcd7f448-0e19-49ef-8647-5eb43ef16709"}]} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:37:54.227448 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-136559f0-7b73-4aa1-9263-b4856a05e6e7 req-416320b9-c5f8-4e46-9aef-2dc322ddddbf service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:54.228245 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-136559f0-7b73-4aa1-9263-b4856a05e6e7 req-416320b9-c5f8-4e46-9aef-2dc322ddddbf service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:54.245306 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.compute.server_external_events [req-136559f0-7b73-4aa1-9263-b4856a05e6e7 req-416320b9-c5f8-4e46-9aef-2dc322ddddbf service nova] Creating event network-vif-plugged:fcd7f448-0e19-49ef-8647-5eb43ef16709 for instance 006762e8-f0b5-4be1-b4b3-cd620638df23 on hv-cinder-84617 Jun 23 22:37:54.251594 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [req-136559f0-7b73-4aa1-9263-b4856a05e6e7 req-416320b9-c5f8-4e46-9aef-2dc322ddddbf service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037693 Jun 23 22:37:54.253140 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 123/241] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:37:54.451298 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c17abb75-c2b6-485b-b00d-fcee45a0afa5 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:54.451922 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c17abb75-c2b6-485b-b00d-fcee45a0afa5 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: 006762e8-f0b5-4be1-b4b3-cd620638df23] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:54.459393 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c17abb75-c2b6-485b-b00d-fcee45a0afa5 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:54.460053 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c17abb75-c2b6-485b-b00d-fcee45a0afa5 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:54.460546 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-ff8811c9-87b9-44cb-a2c1-eb79a19170cc tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:54.461180 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c17abb75-c2b6-485b-b00d-fcee45a0afa5 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:54.461623 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c17abb75-c2b6-485b-b00d-fcee45a0afa5 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:54.462131 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-ff8811c9-87b9-44cb-a2c1-eb79a19170cc tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:54.466279 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:37:54.475103 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ff8811c9-87b9-44cb-a2c1-eb79a19170cc tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:54.476088 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ff8811c9-87b9-44cb-a2c1-eb79a19170cc tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:54.477496 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ff8811c9-87b9-44cb-a2c1-eb79a19170cc tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:54.478500 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ff8811c9-87b9-44cb-a2c1-eb79a19170cc tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:54.694109 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c17abb75-c2b6-485b-b00d-fcee45a0afa5 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:54.703131 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c17abb75-c2b6-485b-b00d-fcee45a0afa5 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/006762e8-f0b5-4be1-b4b3-cd620638df23" status: 200 len: 1313 microversion: 2.1 time: 0.256745 Jun 23 22:37:54.704655 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 119/242] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:54 2022] GET /compute/v2.1/servers/006762e8-f0b5-4be1-b4b3-cd620638df23 => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:54.711479 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-ff8811c9-87b9-44cb-a2c1-eb79a19170cc tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:54.721332 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-ff8811c9-87b9-44cb-a2c1-eb79a19170cc tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4" status: 200 len: 1522 microversion: 2.1 time: 0.265427 Jun 23 22:37:54.722177 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 124/243] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:54 2022] GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:37:55.721197 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-05ed5722-c118-4b50-9ab3-b3f0925d8ae1 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:55.721993 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-05ed5722-c118-4b50-9ab3-b3f0925d8ae1 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: 006762e8-f0b5-4be1-b4b3-cd620638df23] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:55.730011 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-05ed5722-c118-4b50-9ab3-b3f0925d8ae1 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:55.730506 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-05ed5722-c118-4b50-9ab3-b3f0925d8ae1 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:55.731930 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-05ed5722-c118-4b50-9ab3-b3f0925d8ae1 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:55.732264 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-05ed5722-c118-4b50-9ab3-b3f0925d8ae1 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:55.740074 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-af3c7315-eec9-4b3a-b325-bb179fb6ece8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:55.746358 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-af3c7315-eec9-4b3a-b325-bb179fb6ece8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:55.753682 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-af3c7315-eec9-4b3a-b325-bb179fb6ece8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:55.754188 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-af3c7315-eec9-4b3a-b325-bb179fb6ece8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:55.755818 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-af3c7315-eec9-4b3a-b325-bb179fb6ece8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:55.757306 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-af3c7315-eec9-4b3a-b325-bb179fb6ece8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:55.964263 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-05ed5722-c118-4b50-9ab3-b3f0925d8ae1 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:55.969148 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-af3c7315-eec9-4b3a-b325-bb179fb6ece8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:55.973029 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-05ed5722-c118-4b50-9ab3-b3f0925d8ae1 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/006762e8-f0b5-4be1-b4b3-cd620638df23" status: 200 len: 1313 microversion: 2.1 time: 0.256159 Jun 23 22:37:55.974737 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 120/244] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:55 2022] GET /compute/v2.1/servers/006762e8-f0b5-4be1-b4b3-cd620638df23 => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:55.977622 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-af3c7315-eec9-4b3a-b325-bb179fb6ece8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4" status: 200 len: 1522 microversion: 2.1 time: 0.241335 Jun 23 22:37:55.978186 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 125/245] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:55 2022] GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:37:56.180928 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-3b32b8d1-9aaa-4073-ac5d-c122bf79f7e6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:56.181427 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-3b32b8d1-9aaa-4073-ac5d-c122bf79f7e6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:56.188099 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3b32b8d1-9aaa-4073-ac5d-c122bf79f7e6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:56.188754 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3b32b8d1-9aaa-4073-ac5d-c122bf79f7e6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:56.189781 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3b32b8d1-9aaa-4073-ac5d-c122bf79f7e6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:56.190678 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3b32b8d1-9aaa-4073-ac5d-c122bf79f7e6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:56.217473 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-3b32b8d1-9aaa-4073-ac5d-c122bf79f7e6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1/ips" status: 200 len: 144 microversion: 2.1 time: 0.041201 Jun 23 22:37:56.218059 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 121/246] 10.222.0.43 () {58 vars in 1247 bytes} [Thu Jun 23 22:37:56 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1/ips => generated 144 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:37:56.994080 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-07e29998-6039-4cf6-aca3-e92738a62a26 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:56.994823 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-07e29998-6039-4cf6-aca3-e92738a62a26 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: 006762e8-f0b5-4be1-b4b3-cd620638df23] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:56.995964 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c4599d68-5fa8-403f-a6ac-59e8bd3c49d9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:56.996576 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c4599d68-5fa8-403f-a6ac-59e8bd3c49d9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:57.003193 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-07e29998-6039-4cf6-aca3-e92738a62a26 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:57.003789 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-07e29998-6039-4cf6-aca3-e92738a62a26 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:57.004481 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c4599d68-5fa8-403f-a6ac-59e8bd3c49d9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:57.004876 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-07e29998-6039-4cf6-aca3-e92738a62a26 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:57.005026 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c4599d68-5fa8-403f-a6ac-59e8bd3c49d9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:57.005820 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-07e29998-6039-4cf6-aca3-e92738a62a26 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:57.005949 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c4599d68-5fa8-403f-a6ac-59e8bd3c49d9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:57.006469 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c4599d68-5fa8-403f-a6ac-59e8bd3c49d9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:57.010834 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=100 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:37:57.216332 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-07e29998-6039-4cf6-aca3-e92738a62a26 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:57.224261 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-07e29998-6039-4cf6-aca3-e92738a62a26 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/006762e8-f0b5-4be1-b4b3-cd620638df23" status: 200 len: 1497 microversion: 2.1 time: 0.236001 Jun 23 22:37:57.224838 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 126/247] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:56 2022] GET /compute/v2.1/servers/006762e8-f0b5-4be1-b4b3-cd620638df23 => generated 1497 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:57.225750 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c4599d68-5fa8-403f-a6ac-59e8bd3c49d9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:57.234508 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c4599d68-5fa8-403f-a6ac-59e8bd3c49d9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4" status: 200 len: 1522 microversion: 2.1 time: 0.242395 Jun 23 22:37:57.235229 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 122/248] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:56 2022] GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:57.937480 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-04750bea-49ff-4e6a-863f-7b527b545db1 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:57.938219 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-04750bea-49ff-4e6a-863f-7b527b545db1 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: 006762e8-f0b5-4be1-b4b3-cd620638df23] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:57.944789 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-04750bea-49ff-4e6a-863f-7b527b545db1 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:57.945241 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-04750bea-49ff-4e6a-863f-7b527b545db1 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:57.946000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-04750bea-49ff-4e6a-863f-7b527b545db1 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:57.946493 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-04750bea-49ff-4e6a-863f-7b527b545db1 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:57.974380 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-04750bea-49ff-4e6a-863f-7b527b545db1 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: 006762e8-f0b5-4be1-b4b3-cd620638df23] Going to try to terminate instance {{(pid=124357) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:37:58.049899 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-04750bea-49ff-4e6a-863f-7b527b545db1 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "DELETE /compute/v2.1/servers/006762e8-f0b5-4be1-b4b3-cd620638df23" status: 204 len: 0 microversion: 2.1 time: 0.117594 Jun 23 22:37:58.050569 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 127/249] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 23 22:37:57 2022] DELETE /compute/v2.1/servers/006762e8-f0b5-4be1-b4b3-cd620638df23 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 22:37:58.059569 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-54928124-d1f0-4270-a536-363267539360 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:58.060907 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-54928124-d1f0-4270-a536-363267539360 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: 006762e8-f0b5-4be1-b4b3-cd620638df23] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:58.066984 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-54928124-d1f0-4270-a536-363267539360 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:58.067423 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-54928124-d1f0-4270-a536-363267539360 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:58.068177 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-54928124-d1f0-4270-a536-363267539360 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:58.068846 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-54928124-d1f0-4270-a536-363267539360 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:58.200417 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-54928124-d1f0-4270-a536-363267539360 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:58.208386 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-54928124-d1f0-4270-a536-363267539360 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/006762e8-f0b5-4be1-b4b3-cd620638df23" status: 200 len: 1503 microversion: 2.1 time: 0.153705 Jun 23 22:37:58.209016 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 123/250] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:58 2022] GET /compute/v2.1/servers/006762e8-f0b5-4be1-b4b3-cd620638df23 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:58.253104 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-fe66ec20-1d01-43ef-90d7-8fafff5f721b tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:58.253836 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-fe66ec20-1d01-43ef-90d7-8fafff5f721b tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:58.259901 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fe66ec20-1d01-43ef-90d7-8fafff5f721b tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:58.260446 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fe66ec20-1d01-43ef-90d7-8fafff5f721b tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:58.261469 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fe66ec20-1d01-43ef-90d7-8fafff5f721b tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:58.262723 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fe66ec20-1d01-43ef-90d7-8fafff5f721b tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:58.409763 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-fe66ec20-1d01-43ef-90d7-8fafff5f721b tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:58.417836 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-fe66ec20-1d01-43ef-90d7-8fafff5f721b tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4" status: 200 len: 1522 microversion: 2.1 time: 0.169025 Jun 23 22:37:58.418434 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 128/251] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:58 2022] GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:59.227054 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-1a96a815-ae54-4ddc-8765-ecc924cb586a tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:59.228555 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-1a96a815-ae54-4ddc-8765-ecc924cb586a tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: 006762e8-f0b5-4be1-b4b3-cd620638df23] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:59.237700 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1a96a815-ae54-4ddc-8765-ecc924cb586a tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:59.242309 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1a96a815-ae54-4ddc-8765-ecc924cb586a tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:59.244219 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1a96a815-ae54-4ddc-8765-ecc924cb586a tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:59.244864 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1a96a815-ae54-4ddc-8765-ecc924cb586a tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:59.424195 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-1a96a815-ae54-4ddc-8765-ecc924cb586a tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:59.432768 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-1a96a815-ae54-4ddc-8765-ecc924cb586a tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/006762e8-f0b5-4be1-b4b3-cd620638df23" status: 200 len: 1503 microversion: 2.1 time: 0.210807 Jun 23 22:37:59.434826 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 124/252] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:59 2022] GET /compute/v2.1/servers/006762e8-f0b5-4be1-b4b3-cd620638df23 => generated 1503 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:37:59.444726 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-ed0f9231-7f6b-4a76-b94e-ba3076c5fcfc tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:59.445362 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-ed0f9231-7f6b-4a76-b94e-ba3076c5fcfc tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:37:59.457213 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ed0f9231-7f6b-4a76-b94e-ba3076c5fcfc tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:59.457653 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ed0f9231-7f6b-4a76-b94e-ba3076c5fcfc tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:59.458416 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ed0f9231-7f6b-4a76-b94e-ba3076c5fcfc tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:37:59.461482 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ed0f9231-7f6b-4a76-b94e-ba3076c5fcfc tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:37:59.633692 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-ed0f9231-7f6b-4a76-b94e-ba3076c5fcfc tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:37:59.643686 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-ed0f9231-7f6b-4a76-b94e-ba3076c5fcfc tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4" status: 200 len: 1522 microversion: 2.1 time: 0.212292 Jun 23 22:37:59.644264 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 129/253] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:37:59 2022] GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:00.294237 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-7635d98f-8153-4428-bbe6-b66c22d30834 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e835c382-3f19-4ec9-a35f-992b8924b333"}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:38:00.302397 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-7635d98f-8153-4428-bbe6-b66c22d30834 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:00.311261 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7635d98f-8153-4428-bbe6-b66c22d30834 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:00.311888 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7635d98f-8153-4428-bbe6-b66c22d30834 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:00.312761 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7635d98f-8153-4428-bbe6-b66c22d30834 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:00.313283 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7635d98f-8153-4428-bbe6-b66c22d30834 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:00.453867 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-4e09ae2e-f67b-492a-aba7-f13dd4655f07 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:00.455228 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-4e09ae2e-f67b-492a-aba7-f13dd4655f07 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: 006762e8-f0b5-4be1-b4b3-cd620638df23] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:00.469432 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-4e09ae2e-f67b-492a-aba7-f13dd4655f07 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:00.469868 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-4e09ae2e-f67b-492a-aba7-f13dd4655f07 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:00.470643 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-4e09ae2e-f67b-492a-aba7-f13dd4655f07 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:00.472873 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-4e09ae2e-f67b-492a-aba7-f13dd4655f07 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:00.662304 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-4e09ae2e-f67b-492a-aba7-f13dd4655f07 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:00.671896 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-4e09ae2e-f67b-492a-aba7-f13dd4655f07 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/006762e8-f0b5-4be1-b4b3-cd620638df23" status: 200 len: 1461 microversion: 2.1 time: 0.224138 Jun 23 22:38:00.684406 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 130/254] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:00 2022] GET /compute/v2.1/servers/006762e8-f0b5-4be1-b4b3-cd620638df23 => generated 1461 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:00.684406 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-238f7f84-bbd2-4dec-8ef5-03e52caac9fc tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:00.684406 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-238f7f84-bbd2-4dec-8ef5-03e52caac9fc tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:00.702063 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-238f7f84-bbd2-4dec-8ef5-03e52caac9fc tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:00.702550 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-238f7f84-bbd2-4dec-8ef5-03e52caac9fc tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:00.703917 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-238f7f84-bbd2-4dec-8ef5-03e52caac9fc tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:00.704352 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-238f7f84-bbd2-4dec-8ef5-03e52caac9fc tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:00.885544 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-238f7f84-bbd2-4dec-8ef5-03e52caac9fc tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:00.898001 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-238f7f84-bbd2-4dec-8ef5-03e52caac9fc tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4" status: 200 len: 1522 microversion: 2.1 time: 0.221007 Jun 23 22:38:00.899225 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 131/255] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:00 2022] GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:00.906384 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [req-fa1e7a55-f52c-4acb-9ec6-0065a2ee8dd6 req-c06a9fbb-9c5e-4c42-9999-52f4cdf384d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "006762e8-f0b5-4be1-b4b3-cd620638df23", "name": "network-vif-deleted", "tag": "fcd7f448-0e19-49ef-8647-5eb43ef16709"}]} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:38:00.915613 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-fa1e7a55-f52c-4acb-9ec6-0065a2ee8dd6 req-c06a9fbb-9c5e-4c42-9999-52f4cdf384d0 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:00.924543 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-fa1e7a55-f52c-4acb-9ec6-0065a2ee8dd6 req-c06a9fbb-9c5e-4c42-9999-52f4cdf384d0 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:00.953026 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.compute.server_external_events [req-fa1e7a55-f52c-4acb-9ec6-0065a2ee8dd6 req-c06a9fbb-9c5e-4c42-9999-52f4cdf384d0 service nova] Creating event network-vif-deleted:fcd7f448-0e19-49ef-8647-5eb43ef16709 for instance 006762e8-f0b5-4be1-b4b3-cd620638df23 on hv-cinder-84617 Jun 23 22:38:00.964789 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [req-fa1e7a55-f52c-4acb-9ec6-0065a2ee8dd6 req-c06a9fbb-9c5e-4c42-9999-52f4cdf384d0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063702 Jun 23 22:38:00.968157 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 132/256] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:38:01.256862 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-7635d98f-8153-4428-bbe6-b66c22d30834 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "POST /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.973371 Jun 23 22:38:01.257475 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 125/257] 10.222.0.43 () {60 vars in 1322 bytes} [Thu Jun 23 22:38:00 2022] POST /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1/os-volume_attachments => generated 194 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:38:01.694050 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-2f727b8e-d0da-4bf3-a398-524cf05e5cb0 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:01.694751 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-2f727b8e-d0da-4bf3-a398-524cf05e5cb0 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: 006762e8-f0b5-4be1-b4b3-cd620638df23] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:01.703130 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2f727b8e-d0da-4bf3-a398-524cf05e5cb0 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:01.703944 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2f727b8e-d0da-4bf3-a398-524cf05e5cb0 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:01.704371 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2f727b8e-d0da-4bf3-a398-524cf05e5cb0 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:01.704791 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2f727b8e-d0da-4bf3-a398-524cf05e5cb0 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:01.737793 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2f727b8e-d0da-4bf3-a398-524cf05e5cb0 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:01.738243 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2f727b8e-d0da-4bf3-a398-524cf05e5cb0 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:01.738762 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.objects.instance [None req-2f727b8e-d0da-4bf3-a398-524cf05e5cb0 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lazy-loading 'fault' on Instance uuid 006762e8-f0b5-4be1-b4b3-cd620638df23 {{(pid=124357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:38:01.794800 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-2f727b8e-d0da-4bf3-a398-524cf05e5cb0 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbe630f5c7c243588c5bd33023775d69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4fb6c541ee04ebea81001c24c67d779', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:01.799970 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:38:01.807380 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-2f727b8e-d0da-4bf3-a398-524cf05e5cb0 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/006762e8-f0b5-4be1-b4b3-cd620638df23" status: 200 len: 1303 microversion: 2.1 time: 0.118587 Jun 23 22:38:01.808491 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 133/258] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:01 2022] GET /compute/v2.1/servers/006762e8-f0b5-4be1-b4b3-cd620638df23 => generated 1303 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:01.920008 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-34382b4d-d699-4e53-b3d8-560ca53370c6 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:01.921823 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-34382b4d-d699-4e53-b3d8-560ca53370c6 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:01.930587 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-34382b4d-d699-4e53-b3d8-560ca53370c6 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:01.931455 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-34382b4d-d699-4e53-b3d8-560ca53370c6 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:01.932713 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-34382b4d-d699-4e53-b3d8-560ca53370c6 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:01.933198 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-34382b4d-d699-4e53-b3d8-560ca53370c6 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:02.091219 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-34382b4d-d699-4e53-b3d8-560ca53370c6 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:02.101890 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-34382b4d-d699-4e53-b3d8-560ca53370c6 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4" status: 200 len: 1522 microversion: 2.1 time: 0.189665 Jun 23 22:38:02.102655 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 126/259] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:01 2022] GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:02.826250 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-dd28301d-dd87-419b-b034-0f2643ffe3a3 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:02.827090 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-dd28301d-dd87-419b-b034-0f2643ffe3a3 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] [instance: 006762e8-f0b5-4be1-b4b3-cd620638df23] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:02.836148 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-dd28301d-dd87-419b-b034-0f2643ffe3a3 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:02.836926 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-dd28301d-dd87-419b-b034-0f2643ffe3a3 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:02.837744 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-dd28301d-dd87-419b-b034-0f2643ffe3a3 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:02.838371 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-dd28301d-dd87-419b-b034-0f2643ffe3a3 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:02.858581 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.wsgi [None req-dd28301d-dd87-419b-b034-0f2643ffe3a3 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] HTTP exception thrown: Instance 006762e8-f0b5-4be1-b4b3-cd620638df23 could not be found. Jun 23 22:38:02.860806 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-dd28301d-dd87-419b-b034-0f2643ffe3a3 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Request method failure captured: Jun 23 22:38:02.860806 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: request: GET /compute/v2.1/servers/006762e8-f0b5-4be1-b4b3-cd620638df23 HTTP/1.1 Jun 23 22:38:02.860806 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept: application/json Jun 23 22:38:02.860806 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept-Encoding: identity Jun 23 22:38:02.860806 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Connection: close Jun 23 22:38:02.860806 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Length: 0 Jun 23 22:38:02.860806 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Type: application/json Jun 23 22:38:02.860806 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Host: 10.222.0.43 Jun 23 22:38:02.860806 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Openstack-System-Scope: None Jun 23 22:38:02.860806 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: User-Agent: python-urllib3/1.26.9 Jun 23 22:38:02.860806 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Auth-Token: gAAAAABitOsU28Kr0yxkV7ELEBWMksx4PG6BmH5VZojU5TBQaS4FVi-c_FtuE_1JkRqbb-ityjk9tl7Ju0X9YXO0RWmGFDxnu6Di5xbF7uCHldhIKeJgT0lTfHmq6ZEZka8DgSe9NM-prv2ij5rBcByShgS27NL0P2UfwFmkYcYww8H-i0HaXKY Jun 23 22:38:02.860806 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Id: None Jun 23 22:38:02.860806 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Name: None Jun 23 22:38:02.860806 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Identity-Status: Confirmed Jun 23 22:38:02.860806 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Is-Admin-Project: True Jun 23 22:38:02.860806 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Id: default Jun 23 22:38:02.860806 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Name: Default Jun 23 22:38:02.860806 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Id: e4fb6c541ee04ebea81001c24c67d779 Jun 23 22:38:02.860806 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Name: tempest-VolumesActionsTest-2082090692 Jun 23 22:38:02.860806 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Role: reader,member Jun 23 22:38:02.860806 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Roles: reader,member Jun 23 22:38:02.862094 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e4fb6c541ee04ebea81001c24c67d779"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/e4fb6c541ee04ebea81001c24c67d779"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_e4fb6c541ee04ebea81001c24c67d779", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/e4fb6c541ee04ebea81001c24c67d779"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:38:02.862094 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant: tempest-VolumesActionsTest-2082090692 Jun 23 22:38:02.862094 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Id: e4fb6c541ee04ebea81001c24c67d779 Jun 23 22:38:02.862094 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Name: tempest-VolumesActionsTest-2082090692 Jun 23 22:38:02.862094 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User: tempest-VolumesActionsTest-2082090692-project Jun 23 22:38:02.862094 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Id: default Jun 23 22:38:02.862094 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Name: Default Jun 23 22:38:02.862094 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Id: bbe630f5c7c243588c5bd33023775d69 Jun 23 22:38:02.862094 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Name: tempest-VolumesActionsTest-2082090692-project Jun 23 22:38:02.862094 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: method: > Jun 23 22:38:02.862094 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: exception: Instance 006762e8-f0b5-4be1-b4b3-cd620638df23 could not be found. Jun 23 22:38:02.862094 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: action_args: {'id': '006762e8-f0b5-4be1-b4b3-cd620638df23'} Jun 23 22:38:02.862866 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:38:02.862866 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:38:02.862866 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:38:02.862866 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:38:02.862866 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:38:02.862866 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:38:02.862866 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:38:02.862866 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:38:02.862866 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:38:02.862866 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:38:02.862866 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 006762e8-f0b5-4be1-b4b3-cd620638df23 could not be found. Jun 23 22:38:02.862866 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:38:02.862866 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:38:02.862866 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:38:02.862866 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:38:02.862866 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:38:02.862866 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:38:02.862866 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:38:02.862866 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:38:02.862866 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:38:02.870444 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:38:02.870444 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:38:02.870444 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:38:02.870444 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:38:02.870444 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:38:02.870444 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:38:02.870444 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:38:02.870444 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 006762e8-f0b5-4be1-b4b3-cd620638df23 could not be found. Jun 23 22:38:02.870444 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:38:02.870444 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:38:02.870444 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:38:02.870444 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:38:02.870444 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:38:02.870444 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:38:02.870444 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:38:02.870444 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:38:02.870444 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 006762e8-f0b5-4be1-b4b3-cd620638df23 could not be found. Jun 23 22:38:02.870444 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:38:02.872027 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-dd28301d-dd87-419b-b034-0f2643ffe3a3 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] Returning 404 to user: Instance 006762e8-f0b5-4be1-b4b3-cd620638df23 could not be found. {{(pid=124357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:38:02.872027 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-dd28301d-dd87-419b-b034-0f2643ffe3a3 tempest-VolumesActionsTest-2082090692 tempest-VolumesActionsTest-2082090692-project] 10.222.0.43 "GET /compute/v2.1/servers/006762e8-f0b5-4be1-b4b3-cd620638df23" status: 404 len: 111 microversion: 2.1 time: 0.040850 Jun 23 22:38:02.872027 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 134/260] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:02 2022] GET /compute/v2.1/servers/006762e8-f0b5-4be1-b4b3-cd620638df23 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:38:03.119892 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-8cbd78bb-410d-480a-a274-0a5b0987a14a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:03.120672 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-8cbd78bb-410d-480a-a274-0a5b0987a14a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:03.130382 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8cbd78bb-410d-480a-a274-0a5b0987a14a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:03.130832 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8cbd78bb-410d-480a-a274-0a5b0987a14a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:03.132701 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8cbd78bb-410d-480a-a274-0a5b0987a14a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:03.134954 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8cbd78bb-410d-480a-a274-0a5b0987a14a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:03.306619 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-8cbd78bb-410d-480a-a274-0a5b0987a14a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:03.315921 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-8cbd78bb-410d-480a-a274-0a5b0987a14a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4" status: 200 len: 1522 microversion: 2.1 time: 0.199858 Jun 23 22:38:03.316618 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 127/261] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:03 2022] GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:03.888739 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-c9c0fb0b-3e63-41ce-aa08-039dc55a9cbe tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1647095533", "imageRef": "ac7d441e-2ac8-49ad-9dc5-3c55bd4b4f8b", "flavorRef": "452"}} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:38:03.950595 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.network.neutron [None req-c9c0fb0b-3e63-41ce-aa08-039dc55a9cbe tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] validate_networks() for None {{(pid=124357) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:38:04.259005 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-c9c0fb0b-3e63-41ce-aa08-039dc55a9cbe tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Flavor limits 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:38:04.259447 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-c9c0fb0b-3e63-41ce-aa08-039dc55a9cbe tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Image limits 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:38:04.260120 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-c9c0fb0b-3e63-41ce-aa08-039dc55a9cbe tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Flavor pref 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:38:04.260525 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-c9c0fb0b-3e63-41ce-aa08-039dc55a9cbe tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Image pref 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:38:04.260928 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-c9c0fb0b-3e63-41ce-aa08-039dc55a9cbe tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:38:04.269991 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c9c0fb0b-3e63-41ce-aa08-039dc55a9cbe tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:04.270439 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c9c0fb0b-3e63-41ce-aa08-039dc55a9cbe tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:04.271273 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c9c0fb0b-3e63-41ce-aa08-039dc55a9cbe tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:04.271705 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c9c0fb0b-3e63-41ce-aa08-039dc55a9cbe tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:04.290474 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-c9c0fb0b-3e63-41ce-aa08-039dc55a9cbe tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Getting quotas for project f7bc6b504b764fe6b3f892e2a8a88a05. Resources: {'instances', 'cores', 'ram'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:38:04.295051 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-c9c0fb0b-3e63-41ce-aa08-039dc55a9cbe tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Getting quotas for user 34f24b9b6f2d45c4907ce8cb419ab4a4 and project f7bc6b504b764fe6b3f892e2a8a88a05. Resources: {'instances', 'cores', 'ram'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:38:04.306136 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-c9c0fb0b-3e63-41ce-aa08-039dc55a9cbe tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Going to run 1 instances... {{(pid=124357) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:38:04.308649 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-c9c0fb0b-3e63-41ce-aa08-039dc55a9cbe tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] [instance: f2ce378d-902b-4621-84aa-51b964ae5fa4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ac7d441e-2ac8-49ad-9dc5-3c55bd4b4f8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:38:04.334508 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-6e92b251-ff1b-4732-bec3-b13083a3c6cd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:04.335322 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-6e92b251-ff1b-4732-bec3-b13083a3c6cd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:04.343683 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6e92b251-ff1b-4732-bec3-b13083a3c6cd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:04.344370 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6e92b251-ff1b-4732-bec3-b13083a3c6cd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:04.345348 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6e92b251-ff1b-4732-bec3-b13083a3c6cd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:04.346180 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6e92b251-ff1b-4732-bec3-b13083a3c6cd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:04.354047 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-c9c0fb0b-3e63-41ce-aa08-039dc55a9cbe tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.470708 Jun 23 22:38:04.354764 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 135/262] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Jun 23 22:38:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 472 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 22:38:04.365048 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-75d5ef50-fd84-46f4-b323-0262d738daa7 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:04.365876 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-75d5ef50-fd84-46f4-b323-0262d738daa7 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] [instance: f2ce378d-902b-4621-84aa-51b964ae5fa4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:04.427535 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-75d5ef50-fd84-46f4-b323-0262d738daa7 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f24b9b6f2d45c4907ce8cb419ab4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bc6b504b764fe6b3f892e2a8a88a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:04.436399 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-75d5ef50-fd84-46f4-b323-0262d738daa7 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] 10.222.0.43 "GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4" status: 200 len: 1215 microversion: 2.1 time: 0.074942 Jun 23 22:38:04.437355 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 136/263] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:04 2022] GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4 => generated 1215 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:38:04.538107 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-6e92b251-ff1b-4732-bec3-b13083a3c6cd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:04.547736 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-6e92b251-ff1b-4732-bec3-b13083a3c6cd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4" status: 200 len: 1502 microversion: 2.1 time: 0.217856 Jun 23 22:38:04.548313 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 128/264] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:04 2022] GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 => generated 1502 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:04.565561 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-fac25373-73fb-483e-a9ca-4fafe7ef57cd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0686cb00-2d48-465e-acb3-ce52d519ab0a"}} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:38:04.567172 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-fac25373-73fb-483e-a9ca-4fafe7ef57cd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:04.575261 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fac25373-73fb-483e-a9ca-4fafe7ef57cd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:04.576337 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fac25373-73fb-483e-a9ca-4fafe7ef57cd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:04.577294 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fac25373-73fb-483e-a9ca-4fafe7ef57cd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:04.577907 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fac25373-73fb-483e-a9ca-4fafe7ef57cd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:04.621226 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.wsgi [None req-fac25373-73fb-483e-a9ca-4fafe7ef57cd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] HTTP exception thrown: Cannot 'attach_volume' instance 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 while it is in vm_state rescued Jun 23 22:38:04.623712 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-fac25373-73fb-483e-a9ca-4fafe7ef57cd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Request method failure captured: Jun 23 22:38:04.623712 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: request: POST /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4/os-volume_attachments HTTP/1.1 Jun 23 22:38:04.623712 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept: application/json Jun 23 22:38:04.623712 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept-Encoding: identity Jun 23 22:38:04.623712 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Connection: close Jun 23 22:38:04.623712 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Length: 74 Jun 23 22:38:04.623712 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Type: application/json Jun 23 22:38:04.623712 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Host: 10.222.0.43 Jun 23 22:38:04.623712 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Openstack-System-Scope: None Jun 23 22:38:04.623712 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: User-Agent: python-urllib3/1.26.9 Jun 23 22:38:04.623712 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Auth-Token: gAAAAABitOraLpi8Pvpi8Qc1Y4M-Pla8fum-8INT6fklVezA6HYJEy-_7LboWQXaqmKodYFNcJuBs2lqdl0aMvfex_YkVFYW6g3zGPxaMIBdBYAGSe9Z9h-akU9iV1MHzsT9eii0Id3pUsBpLUHlU69nBSDw0uRkdeq0OpdeT6mYb1v54X9To2I Jun 23 22:38:04.623712 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Id: None Jun 23 22:38:04.623712 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Name: None Jun 23 22:38:04.623712 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Identity-Status: Confirmed Jun 23 22:38:04.623712 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Is-Admin-Project: True Jun 23 22:38:04.623712 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Id: default Jun 23 22:38:04.623712 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Name: Default Jun 23 22:38:04.623712 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Id: 192d1c8d15ce462dbf10fc3b519ab253 Jun 23 22:38:04.623712 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-675175554 Jun 23 22:38:04.623712 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Role: reader,member Jun 23 22:38:04.623712 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Roles: reader,member Jun 23 22:38:04.625170 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/192d1c8d15ce462dbf10fc3b519ab253"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/192d1c8d15ce462dbf10fc3b519ab253"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_192d1c8d15ce462dbf10fc3b519ab253", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/192d1c8d15ce462dbf10fc3b519ab253"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:38:04.625170 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant: tempest-ServerRescueNegativeTestJSON-675175554 Jun 23 22:38:04.625170 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Id: 192d1c8d15ce462dbf10fc3b519ab253 Jun 23 22:38:04.625170 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-675175554 Jun 23 22:38:04.625170 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User: tempest-ServerRescueNegativeTestJSON-675175554-project Jun 23 22:38:04.625170 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Id: default Jun 23 22:38:04.625170 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Name: Default Jun 23 22:38:04.625170 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Id: dc246e144afc46698000f7f53ef6489e Jun 23 22:38:04.625170 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Name: tempest-ServerRescueNegativeTestJSON-675175554-project Jun 23 22:38:04.625170 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Jun 23 22:38:04.625170 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: {"volumeAttachment": {"volumeId": "0686cb00-2d48-465e-acb3-ce52d519ab0a"}} Jun 23 22:38:04.625170 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: method: > Jun 23 22:38:04.625888 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: exception: Cannot 'attach_volume' instance 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 while it is in vm_state rescued Jun 23 22:38:04.625888 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: action_args: {'server_id': '903f0ba6-4cc4-4533-8e70-b8f58c13d4c4', 'body': {'volumeAttachment': {'volumeId': '0686cb00-2d48-465e-acb3-ce52d519ab0a'}}} Jun 23 22:38:04.625888 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:38:04.625888 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:38:04.625888 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 23 22:38:04.625888 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 23 22:38:04.625888 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 22:38:04.625888 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 22:38:04.625888 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 23 22:38:04.625888 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 23 22:38:04.625888 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 23 22:38:04.625888 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:38:04.625888 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:38:04.625888 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:38:04.625888 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:38:04.625888 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:38:04.625888 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:38:04.625888 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:38:04.625888 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:38:04.627292 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:38:04.627292 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:38:04.627292 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 22:38:04.627292 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 22:38:04.627292 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 22:38:04.627292 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 22:38:04.627292 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 22:38:04.627292 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 22:38:04.627292 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 23 22:38:04.627292 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 23 22:38:04.627292 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 23 22:38:04.627292 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 23 22:38:04.627292 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 while it is in vm_state rescued Jun 23 22:38:04.627292 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:38:04.627292 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:38:04.627292 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:38:04.627292 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:38:04.627292 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:38:04.627292 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:38:04.628526 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:38:04.628526 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:38:04.628526 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 while it is in vm_state rescued Jun 23 22:38:04.628526 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:38:04.628526 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-fac25373-73fb-483e-a9ca-4fafe7ef57cd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Returning 409 to user: Cannot 'attach_volume' instance 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 while it is in vm_state rescued {{(pid=124357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:38:04.628526 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-fac25373-73fb-483e-a9ca-4fafe7ef57cd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "POST /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.063648 Jun 23 22:38:04.628526 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 137/265] 10.222.0.43 () {60 vars in 1322 bytes} [Thu Jun 23 22:38:04 2022] POST /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4/os-volume_attachments => generated 152 bytes in 65 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 23 22:38:04.639410 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-9f93c37c-5ba8-440d-8946-b9704b3a8066 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:38:04.639950 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-9f93c37c-5ba8-440d-8946-b9704b3a8066 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:04.646034 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9f93c37c-5ba8-440d-8946-b9704b3a8066 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:04.646720 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9f93c37c-5ba8-440d-8946-b9704b3a8066 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:04.647711 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9f93c37c-5ba8-440d-8946-b9704b3a8066 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:04.648223 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9f93c37c-5ba8-440d-8946-b9704b3a8066 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:04.732952 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-9f93c37c-5ba8-440d-8946-b9704b3a8066 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "POST /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4/action" status: 202 len: 0 microversion: 2.1 time: 0.098058 Jun 23 22:38:04.734096 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 129/266] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Jun 23 22:38:04 2022] POST /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:38:04.744944 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-2506697e-48e0-4d79-987c-82dce76bd6a4 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:04.749725 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-2506697e-48e0-4d79-987c-82dce76bd6a4 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:04.759376 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2506697e-48e0-4d79-987c-82dce76bd6a4 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:04.759816 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2506697e-48e0-4d79-987c-82dce76bd6a4 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:04.760712 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2506697e-48e0-4d79-987c-82dce76bd6a4 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:04.763306 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2506697e-48e0-4d79-987c-82dce76bd6a4 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:04.929580 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-2506697e-48e0-4d79-987c-82dce76bd6a4 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:04.937160 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-2506697e-48e0-4d79-987c-82dce76bd6a4 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4" status: 200 len: 1510 microversion: 2.1 time: 0.196198 Jun 23 22:38:04.937819 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 138/267] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:04 2022] GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 => generated 1510 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:05.454800 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-2b514574-c79f-445b-981c-8fe1265b5626 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:05.455472 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-2b514574-c79f-445b-981c-8fe1265b5626 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] [instance: f2ce378d-902b-4621-84aa-51b964ae5fa4] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:05.462616 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2b514574-c79f-445b-981c-8fe1265b5626 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:05.463085 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2b514574-c79f-445b-981c-8fe1265b5626 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:05.463949 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2b514574-c79f-445b-981c-8fe1265b5626 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:05.464331 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2b514574-c79f-445b-981c-8fe1265b5626 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:05.529122 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-2b514574-c79f-445b-981c-8fe1265b5626 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f24b9b6f2d45c4907ce8cb419ab4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bc6b504b764fe6b3f892e2a8a88a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:05.537070 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-2b514574-c79f-445b-981c-8fe1265b5626 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] 10.222.0.43 "GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4" status: 200 len: 1219 microversion: 2.1 time: 0.086658 Jun 23 22:38:05.537630 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 130/268] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:05 2022] GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:05.955263 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-153a8603-0578-478f-88a4-7eb93afb3b8e tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:05.955994 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-153a8603-0578-478f-88a4-7eb93afb3b8e tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:05.963566 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-153a8603-0578-478f-88a4-7eb93afb3b8e tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:05.964687 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-153a8603-0578-478f-88a4-7eb93afb3b8e tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:05.965897 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-153a8603-0578-478f-88a4-7eb93afb3b8e tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:05.966402 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-153a8603-0578-478f-88a4-7eb93afb3b8e tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:06.097074 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-153a8603-0578-478f-88a4-7eb93afb3b8e tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:06.105191 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-153a8603-0578-478f-88a4-7eb93afb3b8e tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4" status: 200 len: 1510 microversion: 2.1 time: 0.153696 Jun 23 22:38:06.106288 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 139/269] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:05 2022] GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:06.553453 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-08ef0657-49ef-4b4f-9243-b30b1672248c tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:06.554063 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-08ef0657-49ef-4b4f-9243-b30b1672248c tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] [instance: f2ce378d-902b-4621-84aa-51b964ae5fa4] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:06.560955 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-08ef0657-49ef-4b4f-9243-b30b1672248c tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:06.561392 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-08ef0657-49ef-4b4f-9243-b30b1672248c tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:06.562150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-08ef0657-49ef-4b4f-9243-b30b1672248c tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:06.562575 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-08ef0657-49ef-4b4f-9243-b30b1672248c tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:06.647587 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-08ef0657-49ef-4b4f-9243-b30b1672248c tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f24b9b6f2d45c4907ce8cb419ab4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bc6b504b764fe6b3f892e2a8a88a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:06.659419 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-08ef0657-49ef-4b4f-9243-b30b1672248c tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] 10.222.0.43 "GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4" status: 200 len: 1219 microversion: 2.1 time: 0.109569 Jun 23 22:38:06.660551 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 131/270] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:06 2022] GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4 => generated 1219 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:07.124506 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-5c8bb6ca-ad4d-4a8c-96c9-05432add4775 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:07.125343 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-5c8bb6ca-ad4d-4a8c-96c9-05432add4775 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:07.132288 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5c8bb6ca-ad4d-4a8c-96c9-05432add4775 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:07.132809 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5c8bb6ca-ad4d-4a8c-96c9-05432add4775 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:07.133575 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5c8bb6ca-ad4d-4a8c-96c9-05432add4775 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:07.134184 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5c8bb6ca-ad4d-4a8c-96c9-05432add4775 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:07.270537 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-5c8bb6ca-ad4d-4a8c-96c9-05432add4775 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:07.278776 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-5c8bb6ca-ad4d-4a8c-96c9-05432add4775 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4" status: 200 len: 1510 microversion: 2.1 time: 0.159668 Jun 23 22:38:07.279991 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 140/271] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:07 2022] GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:07.677487 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-027ec056-ec68-4284-be13-5a8b757b5ca7 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:07.678111 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-027ec056-ec68-4284-be13-5a8b757b5ca7 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] [instance: f2ce378d-902b-4621-84aa-51b964ae5fa4] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:07.684950 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-027ec056-ec68-4284-be13-5a8b757b5ca7 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:07.685297 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-027ec056-ec68-4284-be13-5a8b757b5ca7 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:07.686064 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-027ec056-ec68-4284-be13-5a8b757b5ca7 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:07.686493 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-027ec056-ec68-4284-be13-5a8b757b5ca7 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:07.751643 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-027ec056-ec68-4284-be13-5a8b757b5ca7 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f24b9b6f2d45c4907ce8cb419ab4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bc6b504b764fe6b3f892e2a8a88a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:07.762665 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-027ec056-ec68-4284-be13-5a8b757b5ca7 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] 10.222.0.43 "GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4" status: 200 len: 1267 microversion: 2.1 time: 0.088156 Jun 23 22:38:07.763554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 132/272] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:07 2022] GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4 => generated 1267 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:08.297279 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-e04bd3e9-0a40-42af-8df3-c447c01ec642 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:08.297885 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-e04bd3e9-0a40-42af-8df3-c447c01ec642 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:08.303887 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-e04bd3e9-0a40-42af-8df3-c447c01ec642 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:08.304326 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-e04bd3e9-0a40-42af-8df3-c447c01ec642 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:08.305074 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-e04bd3e9-0a40-42af-8df3-c447c01ec642 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:08.305505 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-e04bd3e9-0a40-42af-8df3-c447c01ec642 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:08.439786 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-e04bd3e9-0a40-42af-8df3-c447c01ec642 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:08.447227 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-e04bd3e9-0a40-42af-8df3-c447c01ec642 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4" status: 200 len: 1510 microversion: 2.1 time: 0.154575 Jun 23 22:38:08.447785 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 141/273] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:08 2022] GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:08.778991 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-838c1801-21ef-4317-a230-c3e1b2a064df tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:08.779598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-838c1801-21ef-4317-a230-c3e1b2a064df tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] [instance: f2ce378d-902b-4621-84aa-51b964ae5fa4] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:08.786202 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-838c1801-21ef-4317-a230-c3e1b2a064df tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:08.786626 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-838c1801-21ef-4317-a230-c3e1b2a064df tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:08.787424 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-838c1801-21ef-4317-a230-c3e1b2a064df tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:08.788121 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-838c1801-21ef-4317-a230-c3e1b2a064df tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:08.850016 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-838c1801-21ef-4317-a230-c3e1b2a064df tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f24b9b6f2d45c4907ce8cb419ab4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bc6b504b764fe6b3f892e2a8a88a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:08.857425 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-838c1801-21ef-4317-a230-c3e1b2a064df tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] 10.222.0.43 "GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4" status: 200 len: 1267 microversion: 2.1 time: 0.082356 Jun 23 22:38:08.857976 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 133/274] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:08 2022] GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4 => generated 1267 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:09.466228 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-1a7a21ae-b974-4984-8109-2d541b48ffd4 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:09.466870 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-1a7a21ae-b974-4984-8109-2d541b48ffd4 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:09.472853 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1a7a21ae-b974-4984-8109-2d541b48ffd4 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:09.473296 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1a7a21ae-b974-4984-8109-2d541b48ffd4 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:09.474045 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1a7a21ae-b974-4984-8109-2d541b48ffd4 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:09.474475 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1a7a21ae-b974-4984-8109-2d541b48ffd4 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:09.562694 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-33f4c806-f3b5-4c64-a002-27c14c248910 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:09.563249 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-33f4c806-f3b5-4c64-a002-27c14c248910 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: cd22650e-6851-4f81-a8d4-e4c7ade26c73] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:09.569622 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-33f4c806-f3b5-4c64-a002-27c14c248910 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:09.570066 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-33f4c806-f3b5-4c64-a002-27c14c248910 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:09.570887 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-33f4c806-f3b5-4c64-a002-27c14c248910 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:09.571360 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-33f4c806-f3b5-4c64-a002-27c14c248910 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:09.597074 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-33f4c806-f3b5-4c64-a002-27c14c248910 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73/ips" status: 200 len: 149 microversion: 2.1 time: 0.038948 Jun 23 22:38:09.597668 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 134/275] 10.222.0.43 () {58 vars in 1247 bytes} [Thu Jun 23 22:38:09 2022] GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:38:09.781037 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-1a7a21ae-b974-4984-8109-2d541b48ffd4 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:09.789123 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-1a7a21ae-b974-4984-8109-2d541b48ffd4 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4" status: 200 len: 1510 microversion: 2.1 time: 0.327447 Jun 23 22:38:09.790122 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 142/276] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:09 2022] GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 => generated 1510 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:09.874607 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-3463651d-e628-432a-a32d-9944f5d8b204 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:09.875596 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-3463651d-e628-432a-a32d-9944f5d8b204 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] [instance: f2ce378d-902b-4621-84aa-51b964ae5fa4] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:09.889319 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3463651d-e628-432a-a32d-9944f5d8b204 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:09.889983 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3463651d-e628-432a-a32d-9944f5d8b204 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:09.892988 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3463651d-e628-432a-a32d-9944f5d8b204 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:09.893436 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3463651d-e628-432a-a32d-9944f5d8b204 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:09.961784 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-3463651d-e628-432a-a32d-9944f5d8b204 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f24b9b6f2d45c4907ce8cb419ab4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bc6b504b764fe6b3f892e2a8a88a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:09.969715 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-3463651d-e628-432a-a32d-9944f5d8b204 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] 10.222.0.43 "GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4" status: 200 len: 1275 microversion: 2.1 time: 0.100104 Jun 23 22:38:09.970279 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 135/277] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:09 2022] GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4 => generated 1275 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:10.810341 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-174544f5-48b8-4ce1-86c2-854ab04c8af5 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:10.811072 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-174544f5-48b8-4ce1-86c2-854ab04c8af5 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:10.817806 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-174544f5-48b8-4ce1-86c2-854ab04c8af5 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:10.818513 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-174544f5-48b8-4ce1-86c2-854ab04c8af5 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:10.819324 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-174544f5-48b8-4ce1-86c2-854ab04c8af5 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:10.819795 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-174544f5-48b8-4ce1-86c2-854ab04c8af5 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:10.998717 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-04d8e5bb-e9de-4717-b69b-a69feec2cf2c tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:10.999371 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-04d8e5bb-e9de-4717-b69b-a69feec2cf2c tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] [instance: f2ce378d-902b-4621-84aa-51b964ae5fa4] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:11.018725 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-04d8e5bb-e9de-4717-b69b-a69feec2cf2c tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:11.023708 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-04d8e5bb-e9de-4717-b69b-a69feec2cf2c tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:11.028632 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-04d8e5bb-e9de-4717-b69b-a69feec2cf2c tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:11.033641 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-04d8e5bb-e9de-4717-b69b-a69feec2cf2c tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:11.189316 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-04d8e5bb-e9de-4717-b69b-a69feec2cf2c tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f24b9b6f2d45c4907ce8cb419ab4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bc6b504b764fe6b3f892e2a8a88a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:11.197982 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:38:11.210598 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-174544f5-48b8-4ce1-86c2-854ab04c8af5 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:11.218980 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-04d8e5bb-e9de-4717-b69b-a69feec2cf2c tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] 10.222.0.43 "GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4" status: 200 len: 1273 microversion: 2.1 time: 0.234017 Jun 23 22:38:11.222098 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 136/278] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:10 2022] GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4 => generated 1273 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:11.236113 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-912f4c44-e4f4-42bb-9678-297ab6f3ce21 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00ed731e-c77b-464f-90cf-6ff5fdc8faca"}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:38:11.237268 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-912f4c44-e4f4-42bb-9678-297ab6f3ce21 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: cd22650e-6851-4f81-a8d4-e4c7ade26c73] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:11.244897 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-174544f5-48b8-4ce1-86c2-854ab04c8af5 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4" status: 200 len: 1510 microversion: 2.1 time: 0.438550 Jun 23 22:38:11.250076 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 143/279] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:10 2022] GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 => generated 1510 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:11.261005 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-912f4c44-e4f4-42bb-9678-297ab6f3ce21 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:11.261472 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-912f4c44-e4f4-42bb-9678-297ab6f3ce21 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:11.262849 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-912f4c44-e4f4-42bb-9678-297ab6f3ce21 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:11.263349 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-912f4c44-e4f4-42bb-9678-297ab6f3ce21 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:11.272041 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-2b16ec08-455e-4601-ac6b-3b8f846c859c tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:38:11.288020 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2b16ec08-455e-4601-ac6b-3b8f846c859c tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:11.288468 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2b16ec08-455e-4601-ac6b-3b8f846c859c tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:11.379449 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-2b16ec08-455e-4601-ac6b-3b8f846c859c tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Going to try to stop instance {{(pid=124357) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 23 22:38:11.461411 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-2b16ec08-455e-4601-ac6b-3b8f846c859c tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "POST /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1/action" status: 202 len: 0 microversion: 2.1 time: 0.206869 Jun 23 22:38:11.462015 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 144/280] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Jun 23 22:38:11 2022] POST /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:38:11.472571 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-725f3ce3-446f-44f8-9e5f-58cc038bec58 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:11.472571 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-725f3ce3-446f-44f8-9e5f-58cc038bec58 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:11.486573 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-725f3ce3-446f-44f8-9e5f-58cc038bec58 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:11.487047 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-725f3ce3-446f-44f8-9e5f-58cc038bec58 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:11.487772 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-725f3ce3-446f-44f8-9e5f-58cc038bec58 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:11.488346 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-725f3ce3-446f-44f8-9e5f-58cc038bec58 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:11.780016 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-725f3ce3-446f-44f8-9e5f-58cc038bec58 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:11.811605 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-725f3ce3-446f-44f8-9e5f-58cc038bec58 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1721 microversion: 2.1 time: 0.343825 Jun 23 22:38:11.813510 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 145/281] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:11 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1721 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:12.244588 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-a2ef6f23-fd95-46d9-a47a-de0b2aff0c24 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:12.245309 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-a2ef6f23-fd95-46d9-a47a-de0b2aff0c24 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] [instance: f2ce378d-902b-4621-84aa-51b964ae5fa4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:12.254393 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a2ef6f23-fd95-46d9-a47a-de0b2aff0c24 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:12.254842 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a2ef6f23-fd95-46d9-a47a-de0b2aff0c24 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:12.255858 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a2ef6f23-fd95-46d9-a47a-de0b2aff0c24 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:12.256300 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a2ef6f23-fd95-46d9-a47a-de0b2aff0c24 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:12.410826 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-a2ef6f23-fd95-46d9-a47a-de0b2aff0c24 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f24b9b6f2d45c4907ce8cb419ab4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bc6b504b764fe6b3f892e2a8a88a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:12.418768 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-a2ef6f23-fd95-46d9-a47a-de0b2aff0c24 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] 10.222.0.43 "GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4" status: 200 len: 1315 microversion: 2.1 time: 0.178296 Jun 23 22:38:12.419525 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 146/282] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:12 2022] GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:38:12.424457 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-a47f5553-21f8-48b3-843a-1b19aa905ce7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:12.425045 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-a47f5553-21f8-48b3-843a-1b19aa905ce7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:12.432195 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a47f5553-21f8-48b3-843a-1b19aa905ce7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:12.432827 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a47f5553-21f8-48b3-843a-1b19aa905ce7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:12.433604 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a47f5553-21f8-48b3-843a-1b19aa905ce7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:12.434041 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a47f5553-21f8-48b3-843a-1b19aa905ce7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:12.562858 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-a47f5553-21f8-48b3-843a-1b19aa905ce7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:12.570460 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-a47f5553-21f8-48b3-843a-1b19aa905ce7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4" status: 200 len: 1510 microversion: 2.1 time: 0.149816 Jun 23 22:38:12.571110 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 147/283] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:12 2022] GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:12.830611 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-fc5e2a5e-82d7-4530-9868-918f77a8377f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:12.831250 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-fc5e2a5e-82d7-4530-9868-918f77a8377f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:12.837887 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fc5e2a5e-82d7-4530-9868-918f77a8377f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:12.838270 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fc5e2a5e-82d7-4530-9868-918f77a8377f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:12.839104 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fc5e2a5e-82d7-4530-9868-918f77a8377f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:12.839550 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fc5e2a5e-82d7-4530-9868-918f77a8377f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:13.005136 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-fc5e2a5e-82d7-4530-9868-918f77a8377f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:13.016868 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-fc5e2a5e-82d7-4530-9868-918f77a8377f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1721 microversion: 2.1 time: 0.190012 Jun 23 22:38:13.019266 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 148/284] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:12 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1721 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:13.436624 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-28976965-02ca-4314-9fcf-7d01f77213e8 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:13.437230 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-28976965-02ca-4314-9fcf-7d01f77213e8 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] [instance: f2ce378d-902b-4621-84aa-51b964ae5fa4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:13.444499 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-28976965-02ca-4314-9fcf-7d01f77213e8 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:13.445086 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-28976965-02ca-4314-9fcf-7d01f77213e8 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:13.446043 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-28976965-02ca-4314-9fcf-7d01f77213e8 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:13.446477 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-28976965-02ca-4314-9fcf-7d01f77213e8 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:13.582461 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-28976965-02ca-4314-9fcf-7d01f77213e8 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f24b9b6f2d45c4907ce8cb419ab4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bc6b504b764fe6b3f892e2a8a88a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:13.591617 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-28976965-02ca-4314-9fcf-7d01f77213e8 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] 10.222.0.43 "GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4" status: 200 len: 1315 microversion: 2.1 time: 0.159808 Jun 23 22:38:13.592184 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 149/285] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:13 2022] GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:38:13.596644 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-013b8bde-efcc-418f-991d-3d9249d0a62d tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:13.597237 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-013b8bde-efcc-418f-991d-3d9249d0a62d tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:13.602765 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-013b8bde-efcc-418f-991d-3d9249d0a62d tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:13.603239 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-013b8bde-efcc-418f-991d-3d9249d0a62d tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:13.603990 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-013b8bde-efcc-418f-991d-3d9249d0a62d tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:13.604425 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-013b8bde-efcc-418f-991d-3d9249d0a62d tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:13.737289 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-013b8bde-efcc-418f-991d-3d9249d0a62d tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:13.747179 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-013b8bde-efcc-418f-991d-3d9249d0a62d tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4" status: 200 len: 1510 microversion: 2.1 time: 0.153740 Jun 23 22:38:13.748917 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 150/286] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:13 2022] GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:14.040034 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-3a4a0647-3769-4b11-8205-35e867622ae0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:14.041024 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-3a4a0647-3769-4b11-8205-35e867622ae0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:14.052045 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3a4a0647-3769-4b11-8205-35e867622ae0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:14.052886 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3a4a0647-3769-4b11-8205-35e867622ae0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:14.053839 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3a4a0647-3769-4b11-8205-35e867622ae0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:14.054708 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3a4a0647-3769-4b11-8205-35e867622ae0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:14.224305 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-3a4a0647-3769-4b11-8205-35e867622ae0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:14.235427 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-3a4a0647-3769-4b11-8205-35e867622ae0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1721 microversion: 2.1 time: 0.201859 Jun 23 22:38:14.236473 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 151/287] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:14 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1721 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:38:14.608761 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-dd80502f-bef6-477e-85b1-fdb644c78f5a tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:14.609667 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-dd80502f-bef6-477e-85b1-fdb644c78f5a tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] [instance: f2ce378d-902b-4621-84aa-51b964ae5fa4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:14.612982 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell0:SELECT=2 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:38:14.614145 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell0:SELECT=8 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:38:14.619475 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-dd80502f-bef6-477e-85b1-fdb644c78f5a tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:14.619929 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-dd80502f-bef6-477e-85b1-fdb644c78f5a tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:14.620700 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-dd80502f-bef6-477e-85b1-fdb644c78f5a tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:14.621922 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-dd80502f-bef6-477e-85b1-fdb644c78f5a tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:14.643492 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:38:14.775699 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-dd80502f-bef6-477e-85b1-fdb644c78f5a tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f24b9b6f2d45c4907ce8cb419ab4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bc6b504b764fe6b3f892e2a8a88a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:14.788788 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-dd80502f-bef6-477e-85b1-fdb644c78f5a tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] 10.222.0.43 "GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4" status: 200 len: 1315 microversion: 2.1 time: 0.184567 Jun 23 22:38:14.789401 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 152/288] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:14 2022] GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:38:14.800292 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-d5eeef59-e8a2-4b72-a00c-16ae53db278b tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:14.805364 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-d5eeef59-e8a2-4b72-a00c-16ae53db278b tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:14.809862 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d5eeef59-e8a2-4b72-a00c-16ae53db278b tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:14.810582 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d5eeef59-e8a2-4b72-a00c-16ae53db278b tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:14.811602 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d5eeef59-e8a2-4b72-a00c-16ae53db278b tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:14.812086 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d5eeef59-e8a2-4b72-a00c-16ae53db278b tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:14.976155 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-d5eeef59-e8a2-4b72-a00c-16ae53db278b tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:14.985344 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-d5eeef59-e8a2-4b72-a00c-16ae53db278b tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4" status: 200 len: 1510 microversion: 2.1 time: 0.194430 Jun 23 22:38:14.986149 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 153/289] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:14 2022] GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 => generated 1510 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:15.254588 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-04d36d32-c8da-4326-a4bf-1973554700be tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:15.255391 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-04d36d32-c8da-4326-a4bf-1973554700be tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:15.266078 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-04d36d32-c8da-4326-a4bf-1973554700be tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:15.266529 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-04d36d32-c8da-4326-a4bf-1973554700be tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:15.269690 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-04d36d32-c8da-4326-a4bf-1973554700be tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:15.269690 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-04d36d32-c8da-4326-a4bf-1973554700be tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:15.631755 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-04d36d32-c8da-4326-a4bf-1973554700be tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:15.642324 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-04d36d32-c8da-4326-a4bf-1973554700be tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1721 microversion: 2.1 time: 0.392696 Jun 23 22:38:15.649550 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 154/290] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:15 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1721 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:15.806502 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-c954cd49-d461-4e49-92ce-d52a34011381 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:15.807876 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-c954cd49-d461-4e49-92ce-d52a34011381 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] [instance: f2ce378d-902b-4621-84aa-51b964ae5fa4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:15.845632 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c954cd49-d461-4e49-92ce-d52a34011381 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:15.849311 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c954cd49-d461-4e49-92ce-d52a34011381 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:15.852441 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c954cd49-d461-4e49-92ce-d52a34011381 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:15.853767 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c954cd49-d461-4e49-92ce-d52a34011381 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:15.878781 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-912f4c44-e4f4-42bb-9678-297ab6f3ce21 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "POST /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.655087 Jun 23 22:38:15.881307 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 137/291] 10.222.0.43 () {60 vars in 1322 bytes} [Thu Jun 23 22:38:11 2022] POST /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73/os-volume_attachments => generated 194 bytes in 4659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:38:16.006485 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f74941a7-d6b8-4311-9172-039cf46e2252 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:16.007210 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-f74941a7-d6b8-4311-9172-039cf46e2252 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:16.009560 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:38:16.023269 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f74941a7-d6b8-4311-9172-039cf46e2252 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:16.023710 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f74941a7-d6b8-4311-9172-039cf46e2252 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:16.032524 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f74941a7-d6b8-4311-9172-039cf46e2252 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:16.035789 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f74941a7-d6b8-4311-9172-039cf46e2252 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:16.762511 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-c954cd49-d461-4e49-92ce-d52a34011381 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f24b9b6f2d45c4907ce8cb419ab4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bc6b504b764fe6b3f892e2a8a88a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:16.771468 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-c954cd49-d461-4e49-92ce-d52a34011381 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] 10.222.0.43 "GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4" status: 200 len: 1315 microversion: 2.1 time: 0.969656 Jun 23 22:38:16.784048 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 155/292] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:15 2022] GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4 => generated 1315 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:16.790471 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-662a204e-a17c-499a-b2c2-eb8cddc1af98 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:16.791279 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-662a204e-a17c-499a-b2c2-eb8cddc1af98 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:16.812261 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-662a204e-a17c-499a-b2c2-eb8cddc1af98 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:16.812704 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-662a204e-a17c-499a-b2c2-eb8cddc1af98 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:16.813805 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-662a204e-a17c-499a-b2c2-eb8cddc1af98 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:16.814809 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-662a204e-a17c-499a-b2c2-eb8cddc1af98 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:16.956809 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f74941a7-d6b8-4311-9172-039cf46e2252 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:16.966631 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f74941a7-d6b8-4311-9172-039cf46e2252 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4" status: 200 len: 1516 microversion: 2.1 time: 0.964321 Jun 23 22:38:16.969527 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 138/293] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:16 2022] GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 => generated 1516 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:38:17.241912 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-662a204e-a17c-499a-b2c2-eb8cddc1af98 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:17.260019 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-662a204e-a17c-499a-b2c2-eb8cddc1af98 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1721 microversion: 2.1 time: 0.474233 Jun 23 22:38:17.262118 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 156/294] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:16 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1721 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:17.426032 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-08406d49-6aac-4250-acd0-65e69170deb9 req-04ed68f2-994b-4b52-b137-bb09dbacf6de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2ce378d-902b-4621-84aa-51b964ae5fa4", "tag": "eef93757-ff5c-42de-bec1-9578ae8af3ca"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:38:17.450018 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-08406d49-6aac-4250-acd0-65e69170deb9 req-04ed68f2-994b-4b52-b137-bb09dbacf6de service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:17.450628 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-08406d49-6aac-4250-acd0-65e69170deb9 req-04ed68f2-994b-4b52-b137-bb09dbacf6de service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:17.497072 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-08406d49-6aac-4250-acd0-65e69170deb9 req-04ed68f2-994b-4b52-b137-bb09dbacf6de service nova] Creating event network-changed:eef93757-ff5c-42de-bec1-9578ae8af3ca for instance f2ce378d-902b-4621-84aa-51b964ae5fa4 on hv-cinder-84617 Jun 23 22:38:17.508763 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-08406d49-6aac-4250-acd0-65e69170deb9 req-04ed68f2-994b-4b52-b137-bb09dbacf6de service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086236 Jun 23 22:38:17.512085 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 139/295] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:38:17.791126 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-0410ca40-d98d-435d-bd2e-51b4de6e1cad tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:17.791750 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-0410ca40-d98d-435d-bd2e-51b4de6e1cad tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] [instance: f2ce378d-902b-4621-84aa-51b964ae5fa4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:17.804522 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-0410ca40-d98d-435d-bd2e-51b4de6e1cad tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:17.804961 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-0410ca40-d98d-435d-bd2e-51b4de6e1cad tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:17.805724 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-0410ca40-d98d-435d-bd2e-51b4de6e1cad tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:17.806151 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-0410ca40-d98d-435d-bd2e-51b4de6e1cad tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:17.986617 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-0410ca40-d98d-435d-bd2e-51b4de6e1cad tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f24b9b6f2d45c4907ce8cb419ab4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bc6b504b764fe6b3f892e2a8a88a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:17.996761 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-0410ca40-d98d-435d-bd2e-51b4de6e1cad tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] 10.222.0.43 "GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4" status: 200 len: 1315 microversion: 2.1 time: 0.207339 Jun 23 22:38:17.996761 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 157/296] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:17 2022] GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:18.279372 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-0fe3830b-794f-4264-bd32-ead8d77decc0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:18.280072 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-0fe3830b-794f-4264-bd32-ead8d77decc0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:18.286712 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0fe3830b-794f-4264-bd32-ead8d77decc0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:18.287674 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0fe3830b-794f-4264-bd32-ead8d77decc0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:18.288091 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0fe3830b-794f-4264-bd32-ead8d77decc0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:18.288472 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0fe3830b-794f-4264-bd32-ead8d77decc0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:18.428977 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-0fe3830b-794f-4264-bd32-ead8d77decc0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:18.437892 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-0fe3830b-794f-4264-bd32-ead8d77decc0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1721 microversion: 2.1 time: 0.163115 Jun 23 22:38:18.438455 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 140/297] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:18 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:19.013434 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-0153a98f-bd54-4ad0-90e8-0e3a950063a2 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:19.014059 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-0153a98f-bd54-4ad0-90e8-0e3a950063a2 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] [instance: f2ce378d-902b-4621-84aa-51b964ae5fa4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:19.022141 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-0153a98f-bd54-4ad0-90e8-0e3a950063a2 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:19.024048 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-0153a98f-bd54-4ad0-90e8-0e3a950063a2 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:19.025572 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-0153a98f-bd54-4ad0-90e8-0e3a950063a2 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:19.026399 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-0153a98f-bd54-4ad0-90e8-0e3a950063a2 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:19.293808 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-0153a98f-bd54-4ad0-90e8-0e3a950063a2 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f24b9b6f2d45c4907ce8cb419ab4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bc6b504b764fe6b3f892e2a8a88a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:19.301319 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-0153a98f-bd54-4ad0-90e8-0e3a950063a2 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] 10.222.0.43 "GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4" status: 200 len: 1315 microversion: 2.1 time: 0.292726 Jun 23 22:38:19.301600 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 158/298] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:19 2022] GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:19.455940 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e96471fd-89c1-4816-8f61-f95399c61f07 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:19.457523 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e96471fd-89c1-4816-8f61-f95399c61f07 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:19.464332 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e96471fd-89c1-4816-8f61-f95399c61f07 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:19.465554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e96471fd-89c1-4816-8f61-f95399c61f07 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:19.466626 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e96471fd-89c1-4816-8f61-f95399c61f07 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:19.467105 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e96471fd-89c1-4816-8f61-f95399c61f07 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:19.724298 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e96471fd-89c1-4816-8f61-f95399c61f07 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:19.733652 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e96471fd-89c1-4816-8f61-f95399c61f07 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1721 microversion: 2.1 time: 0.281878 Jun 23 22:38:19.734400 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 141/299] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:19 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1721 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:20.320950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-7f0656f2-6dbb-4386-af41-2c639d18079e tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:20.321665 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-7f0656f2-6dbb-4386-af41-2c639d18079e tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] [instance: f2ce378d-902b-4621-84aa-51b964ae5fa4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:20.332169 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7f0656f2-6dbb-4386-af41-2c639d18079e tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:20.332919 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7f0656f2-6dbb-4386-af41-2c639d18079e tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:20.333882 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7f0656f2-6dbb-4386-af41-2c639d18079e tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:20.343753 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7f0656f2-6dbb-4386-af41-2c639d18079e tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:20.752265 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-6ee8b0be-f58a-4f96-b02f-3a193d920457 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:20.753510 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-6ee8b0be-f58a-4f96-b02f-3a193d920457 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:20.762493 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6ee8b0be-f58a-4f96-b02f-3a193d920457 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:20.763024 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6ee8b0be-f58a-4f96-b02f-3a193d920457 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:20.770777 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6ee8b0be-f58a-4f96-b02f-3a193d920457 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:20.771281 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6ee8b0be-f58a-4f96-b02f-3a193d920457 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:20.969441 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-7f0656f2-6dbb-4386-af41-2c639d18079e tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f24b9b6f2d45c4907ce8cb419ab4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bc6b504b764fe6b3f892e2a8a88a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:20.980159 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-7f0656f2-6dbb-4386-af41-2c639d18079e tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] 10.222.0.43 "GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4" status: 200 len: 1315 microversion: 2.1 time: 0.664243 Jun 23 22:38:20.996312 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 159/300] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:20 2022] GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4 => generated 1315 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:21.006678 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-4a1dfb82-5add-4a8f-8ba4-f94693ddaecf tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Action: 'create', calling method: .version_select at 0x7fb719851dc0>, body: {"keypair": {"name": "tempest-keypair-1197272065", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJfWUs6TrrRoYeZ4bmVZhjzYYDK1Nj5CkfmTl6YgDhJcJ05VgJ8QF1MitdCvsD9NGvf6li7Sw6IeD+TLt/iE4hdvHZscm0/izYyAl4+hWGGlskMT+G5ZUp26ERkU2Tl1Bg=="}} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:38:21.031136 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-4a1dfb82-5add-4a8f-8ba4-f94693ddaecf tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Getting quotas for project 192d1c8d15ce462dbf10fc3b519ab253. Resources: {'key_pairs'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:38:21.036784 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:38:21.038680 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-4a1dfb82-5add-4a8f-8ba4-f94693ddaecf tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Getting quotas for user dc246e144afc46698000f7f53ef6489e and project 192d1c8d15ce462dbf10fc3b519ab253. Resources: {'key_pairs'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:38:21.112237 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-4a1dfb82-5add-4a8f-8ba4-f94693ddaecf tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.113955 Jun 23 22:38:21.112985 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 160/301] 10.222.0.43 () {60 vars in 1158 bytes} [Thu Jun 23 22:38:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:38:21.539705 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-6ee8b0be-f58a-4f96-b02f-3a193d920457 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:21.556618 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-6ee8b0be-f58a-4f96-b02f-3a193d920457 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1721 microversion: 2.1 time: 0.808105 Jun 23 22:38:21.561908 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 142/302] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:20 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1721 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:22.002021 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-5b3d41d1-3f1e-4067-ab57-4cc50d2e4359 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:22.002567 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-5b3d41d1-3f1e-4067-ab57-4cc50d2e4359 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] [instance: f2ce378d-902b-4621-84aa-51b964ae5fa4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:22.015365 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5b3d41d1-3f1e-4067-ab57-4cc50d2e4359 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:22.015852 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5b3d41d1-3f1e-4067-ab57-4cc50d2e4359 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:22.016666 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5b3d41d1-3f1e-4067-ab57-4cc50d2e4359 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:22.017153 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5b3d41d1-3f1e-4067-ab57-4cc50d2e4359 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:22.383148 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-5b3d41d1-3f1e-4067-ab57-4cc50d2e4359 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f24b9b6f2d45c4907ce8cb419ab4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bc6b504b764fe6b3f892e2a8a88a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:22.400324 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-5b3d41d1-3f1e-4067-ab57-4cc50d2e4359 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] 10.222.0.43 "GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4" status: 200 len: 1315 microversion: 2.1 time: 0.403165 Jun 23 22:38:22.413653 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 161/303] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:21 2022] GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4 => generated 1315 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:22.577001 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-bb2c68fb-a270-4080-960c-6740a83444bd tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:22.577954 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-bb2c68fb-a270-4080-960c-6740a83444bd tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:22.609494 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bb2c68fb-a270-4080-960c-6740a83444bd tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:22.610075 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bb2c68fb-a270-4080-960c-6740a83444bd tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:22.616016 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bb2c68fb-a270-4080-960c-6740a83444bd tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:22.617324 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bb2c68fb-a270-4080-960c-6740a83444bd tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:23.397336 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-bb2c68fb-a270-4080-960c-6740a83444bd tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:23.413442 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-bb2c68fb-a270-4080-960c-6740a83444bd tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1721 microversion: 2.1 time: 0.842452 Jun 23 22:38:23.417167 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 143/304] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:22 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1721 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:23.429722 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-6e3f8992-7ebe-46d5-850c-f1e460b4ab06 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:23.431056 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-6e3f8992-7ebe-46d5-850c-f1e460b4ab06 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] [instance: f2ce378d-902b-4621-84aa-51b964ae5fa4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:23.438466 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6e3f8992-7ebe-46d5-850c-f1e460b4ab06 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:23.448123 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6e3f8992-7ebe-46d5-850c-f1e460b4ab06 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:23.448987 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6e3f8992-7ebe-46d5-850c-f1e460b4ab06 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:23.457976 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6e3f8992-7ebe-46d5-850c-f1e460b4ab06 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:23.720470 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-6e3f8992-7ebe-46d5-850c-f1e460b4ab06 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f24b9b6f2d45c4907ce8cb419ab4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bc6b504b764fe6b3f892e2a8a88a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:23.728421 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-6e3f8992-7ebe-46d5-850c-f1e460b4ab06 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] 10.222.0.43 "GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4" status: 200 len: 1315 microversion: 2.1 time: 0.302579 Jun 23 22:38:23.744780 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 162/305] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:23 2022] GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4 => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:24.174500 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-0ca8699c-85f6-420e-8ff3-1e47923cb3b1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-696318076", "imageRef": "ac7d441e-2ac8-49ad-9dc5-3c55bd4b4f8b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "37491e26-b7d3-4482-a2c4-21c5caef5449"}], "security_groups": [{"name": "tempest-securitygroup--627520241"}], "key_name": "tempest-keypair-1197272065", "user_data": "}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:38:24.453963 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.network.neutron [None req-0ca8699c-85f6-420e-8ff3-1e47923cb3b1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] validate_networks() for [('37491e26-b7d3-4482-a2c4-21c5caef5449', None, None, None, None, None)] {{(pid=124358) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:38:24.456941 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-00ba19c0-b2e9-44a5-8fe4-3a637b376fa8 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:24.459193 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-00ba19c0-b2e9-44a5-8fe4-3a637b376fa8 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:24.500073 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-00ba19c0-b2e9-44a5-8fe4-3a637b376fa8 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:24.500893 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-00ba19c0-b2e9-44a5-8fe4-3a637b376fa8 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:24.504349 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-00ba19c0-b2e9-44a5-8fe4-3a637b376fa8 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:24.507113 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-00ba19c0-b2e9-44a5-8fe4-3a637b376fa8 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:25.201480 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-00ba19c0-b2e9-44a5-8fe4-3a637b376fa8 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:25.225301 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-00ba19c0-b2e9-44a5-8fe4-3a637b376fa8 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1721 microversion: 2.1 time: 0.789359 Jun 23 22:38:25.226574 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 163/306] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:24 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1721 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:25.232600 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-ca60ee86-c28f-49df-9299-ea1a33480f04 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:25.235356 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-ca60ee86-c28f-49df-9299-ea1a33480f04 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] [instance: f2ce378d-902b-4621-84aa-51b964ae5fa4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:25.254066 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ca60ee86-c28f-49df-9299-ea1a33480f04 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:25.254867 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ca60ee86-c28f-49df-9299-ea1a33480f04 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:25.255902 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ca60ee86-c28f-49df-9299-ea1a33480f04 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:25.256698 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ca60ee86-c28f-49df-9299-ea1a33480f04 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:26.108394 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-ca60ee86-c28f-49df-9299-ea1a33480f04 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f24b9b6f2d45c4907ce8cb419ab4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bc6b504b764fe6b3f892e2a8a88a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:26.150605 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-ca60ee86-c28f-49df-9299-ea1a33480f04 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] 10.222.0.43 "GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4" status: 200 len: 1315 microversion: 2.1 time: 0.922665 Jun 23 22:38:26.154889 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 164/307] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:25 2022] GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4 => generated 1315 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:26.248684 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-9bb3ef16-e45a-4232-a6a3-c53556a9339f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:26.249938 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-9bb3ef16-e45a-4232-a6a3-c53556a9339f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:26.264609 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9bb3ef16-e45a-4232-a6a3-c53556a9339f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:26.265056 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9bb3ef16-e45a-4232-a6a3-c53556a9339f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:26.272027 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9bb3ef16-e45a-4232-a6a3-c53556a9339f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:26.272477 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9bb3ef16-e45a-4232-a6a3-c53556a9339f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:26.627859 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-0ca8699c-85f6-420e-8ff3-1e47923cb3b1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Flavor limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:38:26.630550 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-0ca8699c-85f6-420e-8ff3-1e47923cb3b1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Image limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:38:26.632047 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-0ca8699c-85f6-420e-8ff3-1e47923cb3b1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Flavor pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:38:26.633769 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-0ca8699c-85f6-420e-8ff3-1e47923cb3b1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Image pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:38:26.634394 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-0ca8699c-85f6-420e-8ff3-1e47923cb3b1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:38:26.650034 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0ca8699c-85f6-420e-8ff3-1e47923cb3b1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:26.650583 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0ca8699c-85f6-420e-8ff3-1e47923cb3b1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:26.651492 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0ca8699c-85f6-420e-8ff3-1e47923cb3b1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:26.653092 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0ca8699c-85f6-420e-8ff3-1e47923cb3b1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:26.693368 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-9bb3ef16-e45a-4232-a6a3-c53556a9339f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:26.693890 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-0ca8699c-85f6-420e-8ff3-1e47923cb3b1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Getting quotas for project 192d1c8d15ce462dbf10fc3b519ab253. Resources: {'instances', 'cores', 'ram'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:38:26.704046 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-0ca8699c-85f6-420e-8ff3-1e47923cb3b1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Getting quotas for user dc246e144afc46698000f7f53ef6489e and project 192d1c8d15ce462dbf10fc3b519ab253. Resources: {'instances', 'cores', 'ram'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:38:26.704435 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-9bb3ef16-e45a-4232-a6a3-c53556a9339f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1721 microversion: 2.1 time: 0.459254 Jun 23 22:38:26.705683 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 165/308] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:26 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1721 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:26.729917 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-0ca8699c-85f6-420e-8ff3-1e47923cb3b1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Going to run 1 instances... {{(pid=124358) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:38:26.735095 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-0ca8699c-85f6-420e-8ff3-1e47923cb3b1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ac7d441e-2ac8-49ad-9dc5-3c55bd4b4f8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:38:26.819053 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-0ca8699c-85f6-420e-8ff3-1e47923cb3b1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.649937 Jun 23 22:38:26.826040 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 144/309] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Jun 23 22:38:24 2022] POST /compute/v2.1/servers => generated 408 bytes in 2658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 22:38:26.844740 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-94143dfb-c0f4-4375-a91f-7dba6bbc2c00 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:26.845842 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-94143dfb-c0f4-4375-a91f-7dba6bbc2c00 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:27.016570 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-94143dfb-c0f4-4375-a91f-7dba6bbc2c00 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:27.042286 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-94143dfb-c0f4-4375-a91f-7dba6bbc2c00 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1245 microversion: 2.1 time: 0.209304 Jun 23 22:38:27.057998 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 166/310] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:26 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1245 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:27.171831 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-1fed595d-371b-4db8-8d85-b6837bedfb26 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:27.172745 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-1fed595d-371b-4db8-8d85-b6837bedfb26 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] [instance: f2ce378d-902b-4621-84aa-51b964ae5fa4] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:27.185725 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1fed595d-371b-4db8-8d85-b6837bedfb26 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:27.194600 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1fed595d-371b-4db8-8d85-b6837bedfb26 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:27.195775 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1fed595d-371b-4db8-8d85-b6837bedfb26 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:27.197550 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1fed595d-371b-4db8-8d85-b6837bedfb26 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:27.591649 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-1fed595d-371b-4db8-8d85-b6837bedfb26 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f24b9b6f2d45c4907ce8cb419ab4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bc6b504b764fe6b3f892e2a8a88a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:27.615366 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-1fed595d-371b-4db8-8d85-b6837bedfb26 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] 10.222.0.43 "GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4" status: 200 len: 1315 microversion: 2.1 time: 0.444041 Jun 23 22:38:27.629485 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 145/311] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:27 2022] GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4 => generated 1315 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:27.728269 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-07e901c3-b4a3-476b-ae8b-406ba2d8d0c8 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:27.730177 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-07e901c3-b4a3-476b-ae8b-406ba2d8d0c8 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:27.749212 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-07e901c3-b4a3-476b-ae8b-406ba2d8d0c8 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:27.754075 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-07e901c3-b4a3-476b-ae8b-406ba2d8d0c8 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:27.764004 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-07e901c3-b4a3-476b-ae8b-406ba2d8d0c8 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:27.769200 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-07e901c3-b4a3-476b-ae8b-406ba2d8d0c8 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:28.070869 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-8d8d5275-3aad-4399-b26b-47e98c44a523 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:28.071519 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-8d8d5275-3aad-4399-b26b-47e98c44a523 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:28.096936 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8d8d5275-3aad-4399-b26b-47e98c44a523 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:28.103473 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8d8d5275-3aad-4399-b26b-47e98c44a523 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:28.106841 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8d8d5275-3aad-4399-b26b-47e98c44a523 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:28.112522 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8d8d5275-3aad-4399-b26b-47e98c44a523 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:28.172727 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-07e901c3-b4a3-476b-ae8b-406ba2d8d0c8 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:28.185029 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-07e901c3-b4a3-476b-ae8b-406ba2d8d0c8 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1721 microversion: 2.1 time: 0.464153 Jun 23 22:38:28.202084 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 167/312] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:27 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1721 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:28.264649 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-8d8d5275-3aad-4399-b26b-47e98c44a523 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:28.273741 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-8d8d5275-3aad-4399-b26b-47e98c44a523 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1297 microversion: 2.1 time: 0.212058 Jun 23 22:38:28.274881 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 146/313] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:28 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1297 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:28.295005 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-a016577b-78aa-4d3b-a437-d7a7d4e2a268 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Action: 'create', calling method: .version_select at 0x7fb719962430>, body: {"keypair": {"name": "tempest-keypair-1455506355", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaJzfUVukhE2M1/GX6n5exMBFUhLlVEXuXYr9pGI+N+thEUmLrdnZuMM8Jo4KHx4LiTxrUSJk4uy1RyPz/3JxyNvhnLMJq3hLWK3bsaalj7Rn3Tep/FZWAHYhFlcxWEXQ=="}} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:38:28.317903 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-a016577b-78aa-4d3b-a437-d7a7d4e2a268 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Getting quotas for project 2735e40fe2564a6d8a5cdc7c32b0b869. Resources: {'key_pairs'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:38:28.323794 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-a016577b-78aa-4d3b-a437-d7a7d4e2a268 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Getting quotas for user 03486c7630314392b85271455d12aba2 and project 2735e40fe2564a6d8a5cdc7c32b0b869. Resources: {'key_pairs'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:38:28.353944 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-a016577b-78aa-4d3b-a437-d7a7d4e2a268 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.064124 Jun 23 22:38:28.354890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 168/314] 10.222.0.43 () {60 vars in 1158 bytes} [Thu Jun 23 22:38:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:38:28.632577 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b3e46da7-c678-40f4-bd1c-15ea7509772d tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:28.633922 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-b3e46da7-c678-40f4-bd1c-15ea7509772d tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] [instance: f2ce378d-902b-4621-84aa-51b964ae5fa4] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:28.650266 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b3e46da7-c678-40f4-bd1c-15ea7509772d tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:28.666452 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b3e46da7-c678-40f4-bd1c-15ea7509772d tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:28.668237 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b3e46da7-c678-40f4-bd1c-15ea7509772d tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:28.668982 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b3e46da7-c678-40f4-bd1c-15ea7509772d tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:28.750114 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [req-dba0df78-5237-479e-9ae3-7ea48d7c11a6 req-f668cfb6-0d3b-435f-b370-031e3b35d021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2ce378d-902b-4621-84aa-51b964ae5fa4", "name": "network-vif-plugged", "status": "completed", "tag": "eef93757-ff5c-42de-bec1-9578ae8af3ca"}]} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:38:28.770286 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-dba0df78-5237-479e-9ae3-7ea48d7c11a6 req-f668cfb6-0d3b-435f-b370-031e3b35d021 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:28.770719 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-dba0df78-5237-479e-9ae3-7ea48d7c11a6 req-f668cfb6-0d3b-435f-b370-031e3b35d021 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:28.843793 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.compute.server_external_events [req-dba0df78-5237-479e-9ae3-7ea48d7c11a6 req-f668cfb6-0d3b-435f-b370-031e3b35d021 service nova] Creating event network-vif-plugged:eef93757-ff5c-42de-bec1-9578ae8af3ca for instance f2ce378d-902b-4621-84aa-51b964ae5fa4 on hv-cinder-84617 Jun 23 22:38:28.861944 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [req-dba0df78-5237-479e-9ae3-7ea48d7c11a6 req-f668cfb6-0d3b-435f-b370-031e3b35d021 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115945 Jun 23 22:38:28.862766 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 169/315] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:38:29.205624 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b3e46da7-c678-40f4-bd1c-15ea7509772d tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f24b9b6f2d45c4907ce8cb419ab4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bc6b504b764fe6b3f892e2a8a88a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:29.209129 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-6fc2aaf2-90f4-4c00-9e4e-7eab664618c0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:29.211610 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-6fc2aaf2-90f4-4c00-9e4e-7eab664618c0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:29.216789 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-b3e46da7-c678-40f4-bd1c-15ea7509772d tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] 10.222.0.43 "GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4" status: 200 len: 1315 microversion: 2.1 time: 0.588464 Jun 23 22:38:29.262402 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 147/316] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:28 2022] GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4 => generated 1315 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:29.264552 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6fc2aaf2-90f4-4c00-9e4e-7eab664618c0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:29.265158 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6fc2aaf2-90f4-4c00-9e4e-7eab664618c0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:29.266120 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6fc2aaf2-90f4-4c00-9e4e-7eab664618c0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:29.266714 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6fc2aaf2-90f4-4c00-9e4e-7eab664618c0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:29.332937 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-80e827ef-91de-416d-a31f-068a33e6b260 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:29.343976 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-80e827ef-91de-416d-a31f-068a33e6b260 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:29.363721 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-80e827ef-91de-416d-a31f-068a33e6b260 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:29.373005 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-80e827ef-91de-416d-a31f-068a33e6b260 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:29.375336 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-80e827ef-91de-416d-a31f-068a33e6b260 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:29.377342 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-80e827ef-91de-416d-a31f-068a33e6b260 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:29.829376 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-80e827ef-91de-416d-a31f-068a33e6b260 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:29.844259 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-80e827ef-91de-416d-a31f-068a33e6b260 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1303 microversion: 2.1 time: 0.515759 Jun 23 22:38:29.844852 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 148/317] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:29 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1303 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:38:29.990692 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-6fc2aaf2-90f4-4c00-9e4e-7eab664618c0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:30.008131 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-6fc2aaf2-90f4-4c00-9e4e-7eab664618c0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1721 microversion: 2.1 time: 0.809511 Jun 23 22:38:30.010528 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 170/318] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:29 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1721 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:38:30.273919 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d68de7a7-c34e-41c0-87f2-7db4790b9827 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:30.274914 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-d68de7a7-c34e-41c0-87f2-7db4790b9827 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] [instance: f2ce378d-902b-4621-84aa-51b964ae5fa4] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:30.288895 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d68de7a7-c34e-41c0-87f2-7db4790b9827 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:30.289756 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d68de7a7-c34e-41c0-87f2-7db4790b9827 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:30.290834 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d68de7a7-c34e-41c0-87f2-7db4790b9827 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:30.293179 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d68de7a7-c34e-41c0-87f2-7db4790b9827 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:30.583649 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d68de7a7-c34e-41c0-87f2-7db4790b9827 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f24b9b6f2d45c4907ce8cb419ab4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bc6b504b764fe6b3f892e2a8a88a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:30.592772 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d68de7a7-c34e-41c0-87f2-7db4790b9827 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] 10.222.0.43 "GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4" status: 200 len: 1315 microversion: 2.1 time: 0.324301 Jun 23 22:38:30.599105 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 149/319] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:30 2022] GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4 => generated 1315 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:30.862277 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-d1c8ae95-3b77-48c8-84bd-4ee53a6d6f62 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:30.863174 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-d1c8ae95-3b77-48c8-84bd-4ee53a6d6f62 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:30.879492 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d1c8ae95-3b77-48c8-84bd-4ee53a6d6f62 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:30.883416 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d1c8ae95-3b77-48c8-84bd-4ee53a6d6f62 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:30.884561 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d1c8ae95-3b77-48c8-84bd-4ee53a6d6f62 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:30.885630 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d1c8ae95-3b77-48c8-84bd-4ee53a6d6f62 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:31.027827 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f94c842e-1002-4407-957f-2b0bfd695a3e tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:31.029288 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-f94c842e-1002-4407-957f-2b0bfd695a3e tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:31.048686 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f94c842e-1002-4407-957f-2b0bfd695a3e tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:31.049533 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f94c842e-1002-4407-957f-2b0bfd695a3e tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:31.050567 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f94c842e-1002-4407-957f-2b0bfd695a3e tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:31.051509 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f94c842e-1002-4407-957f-2b0bfd695a3e tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:31.348683 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-d1c8ae95-3b77-48c8-84bd-4ee53a6d6f62 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:31.361970 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-d1c8ae95-3b77-48c8-84bd-4ee53a6d6f62 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1370 microversion: 2.1 time: 0.498801 Jun 23 22:38:31.371982 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 171/320] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:30 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1370 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:31.613586 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-80543cbd-3db5-4127-9a8b-8bc62e78ddbf tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:31.614725 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-80543cbd-3db5-4127-9a8b-8bc62e78ddbf tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] [instance: f2ce378d-902b-4621-84aa-51b964ae5fa4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:31.636924 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-80543cbd-3db5-4127-9a8b-8bc62e78ddbf tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:31.637698 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-80543cbd-3db5-4127-9a8b-8bc62e78ddbf tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:31.638740 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-80543cbd-3db5-4127-9a8b-8bc62e78ddbf tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:31.639615 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-80543cbd-3db5-4127-9a8b-8bc62e78ddbf tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:31.661654 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell1:SELECT=100 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:38:31.932582 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f94c842e-1002-4407-957f-2b0bfd695a3e tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:31.960246 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f94c842e-1002-4407-957f-2b0bfd695a3e tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1721 microversion: 2.1 time: 0.936311 Jun 23 22:38:31.961520 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 150/321] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:31 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1721 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:38:32.140670 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-80543cbd-3db5-4127-9a8b-8bc62e78ddbf tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f24b9b6f2d45c4907ce8cb419ab4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bc6b504b764fe6b3f892e2a8a88a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:32.154808 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-80543cbd-3db5-4127-9a8b-8bc62e78ddbf tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] 10.222.0.43 "GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4" status: 200 len: 1315 microversion: 2.1 time: 0.543498 Jun 23 22:38:32.155288 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 172/322] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:31 2022] GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4 => generated 1315 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:32.331858 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c5a61682-bb98-4138-b316-7118c763ee7a tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-436782384", "imageRef": "ac7d441e-2ac8-49ad-9dc5-3c55bd4b4f8b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e8170354-014e-4823-a204-b43deead6b56"}], "security_groups": [{"name": "tempest-securitygroup--292966890"}], "key_name": "tempest-keypair-1455506355", "user_data": "}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:38:32.389609 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-2c8cc007-e37d-48e4-a4d6-639cdd6f48dc tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:32.390237 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-2c8cc007-e37d-48e4-a4d6-639cdd6f48dc tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:32.409668 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2c8cc007-e37d-48e4-a4d6-639cdd6f48dc tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:32.412638 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2c8cc007-e37d-48e4-a4d6-639cdd6f48dc tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:32.421543 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2c8cc007-e37d-48e4-a4d6-639cdd6f48dc tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:32.425807 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2c8cc007-e37d-48e4-a4d6-639cdd6f48dc tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:32.689380 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.network.neutron [None req-c5a61682-bb98-4138-b316-7118c763ee7a tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] validate_networks() for [('e8170354-014e-4823-a204-b43deead6b56', None, None, None, None, None)] {{(pid=124358) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:38:33.315763 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-2c8cc007-e37d-48e4-a4d6-639cdd6f48dc tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:33.324708 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-2c8cc007-e37d-48e4-a4d6-639cdd6f48dc tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1370 microversion: 2.1 time: 0.940678 Jun 23 22:38:33.326096 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 173/323] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:32 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1370 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:33.331688 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-e450cc3a-d58d-4950-bd37-b76c6c6c0385 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:33.332498 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-e450cc3a-d58d-4950-bd37-b76c6c6c0385 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:33.339887 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-e450cc3a-d58d-4950-bd37-b76c6c6c0385 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:33.340546 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-e450cc3a-d58d-4950-bd37-b76c6c6c0385 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:33.342250 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-e450cc3a-d58d-4950-bd37-b76c6c6c0385 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:33.342859 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-e450cc3a-d58d-4950-bd37-b76c6c6c0385 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:34.185560 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-e450cc3a-d58d-4950-bd37-b76c6c6c0385 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:34.195200 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-e450cc3a-d58d-4950-bd37-b76c6c6c0385 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1721 microversion: 2.1 time: 0.867880 Jun 23 22:38:34.195965 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 174/324] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:33 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1721 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:34.200889 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-5f94aac4-68b8-4953-bae4-74b0f8ffb7d4 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:34.201714 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-5f94aac4-68b8-4953-bae4-74b0f8ffb7d4 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] [instance: f2ce378d-902b-4621-84aa-51b964ae5fa4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:34.208065 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5f94aac4-68b8-4953-bae4-74b0f8ffb7d4 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:34.208770 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5f94aac4-68b8-4953-bae4-74b0f8ffb7d4 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:34.209792 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5f94aac4-68b8-4953-bae4-74b0f8ffb7d4 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:34.210441 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5f94aac4-68b8-4953-bae4-74b0f8ffb7d4 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:34.820628 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-5f94aac4-68b8-4953-bae4-74b0f8ffb7d4 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f24b9b6f2d45c4907ce8cb419ab4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bc6b504b764fe6b3f892e2a8a88a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:34.826813 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-c5a61682-bb98-4138-b316-7118c763ee7a tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Flavor limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:38:34.827398 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-c5a61682-bb98-4138-b316-7118c763ee7a tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Image limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:38:34.828727 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-c5a61682-bb98-4138-b316-7118c763ee7a tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Flavor pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:38:34.829505 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-c5a61682-bb98-4138-b316-7118c763ee7a tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Image pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:38:34.830271 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-c5a61682-bb98-4138-b316-7118c763ee7a tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:38:34.833545 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-5f94aac4-68b8-4953-bae4-74b0f8ffb7d4 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] 10.222.0.43 "GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4" status: 200 len: 1315 microversion: 2.1 time: 0.636221 Jun 23 22:38:34.834590 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 175/325] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:34 2022] GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4 => generated 1315 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:34.845325 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c5a61682-bb98-4138-b316-7118c763ee7a tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:34.856771 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c5a61682-bb98-4138-b316-7118c763ee7a tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:34.856771 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c5a61682-bb98-4138-b316-7118c763ee7a tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:34.856771 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c5a61682-bb98-4138-b316-7118c763ee7a tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:34.856992 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-2726b957-a60b-4387-b78c-cc1f2f4cd2c2 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:34.856992 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-2726b957-a60b-4387-b78c-cc1f2f4cd2c2 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:34.862520 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2726b957-a60b-4387-b78c-cc1f2f4cd2c2 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:34.863307 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2726b957-a60b-4387-b78c-cc1f2f4cd2c2 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:34.864257 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2726b957-a60b-4387-b78c-cc1f2f4cd2c2 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:34.864859 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2726b957-a60b-4387-b78c-cc1f2f4cd2c2 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:34.919887 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-c5a61682-bb98-4138-b316-7118c763ee7a tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Getting quotas for project 2735e40fe2564a6d8a5cdc7c32b0b869. Resources: {'instances', 'cores', 'ram'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:38:34.926282 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-c5a61682-bb98-4138-b316-7118c763ee7a tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Getting quotas for user 03486c7630314392b85271455d12aba2 and project 2735e40fe2564a6d8a5cdc7c32b0b869. Resources: {'instances', 'cores', 'ram'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:38:34.968428 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c5a61682-bb98-4138-b316-7118c763ee7a tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Going to run 1 instances... {{(pid=124358) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:38:34.971427 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c5a61682-bb98-4138-b316-7118c763ee7a tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: 384878db-4705-4f7b-87ff-0f079208412f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ac7d441e-2ac8-49ad-9dc5-3c55bd4b4f8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:38:35.062347 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c5a61682-bb98-4138-b316-7118c763ee7a tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.734821 Jun 23 22:38:35.063703 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 151/326] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Jun 23 22:38:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 2737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 22:38:35.081552 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-549e103e-b88c-4089-93dd-07500201bf3e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:35.082227 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-549e103e-b88c-4089-93dd-07500201bf3e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: 384878db-4705-4f7b-87ff-0f079208412f] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:35.209525 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-549e103e-b88c-4089-93dd-07500201bf3e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:35.221256 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-549e103e-b88c-4089-93dd-07500201bf3e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f" status: 200 len: 1241 microversion: 2.1 time: 0.148932 Jun 23 22:38:35.227086 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 152/327] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:35 2022] GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f => generated 1241 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:35.238393 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e109c81c-948a-4069-a0d6-01ade1a58ac9 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:35.239443 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e109c81c-948a-4069-a0d6-01ade1a58ac9 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:35.251242 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e109c81c-948a-4069-a0d6-01ade1a58ac9 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:35.252260 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e109c81c-948a-4069-a0d6-01ade1a58ac9 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:35.253210 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e109c81c-948a-4069-a0d6-01ade1a58ac9 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:35.253803 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e109c81c-948a-4069-a0d6-01ade1a58ac9 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:35.402591 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-2726b957-a60b-4387-b78c-cc1f2f4cd2c2 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:35.431057 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-2726b957-a60b-4387-b78c-cc1f2f4cd2c2 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1370 microversion: 2.1 time: 0.565297 Jun 23 22:38:35.431714 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 176/328] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:34 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1370 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:35.645022 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e109c81c-948a-4069-a0d6-01ade1a58ac9 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:35.654961 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e109c81c-948a-4069-a0d6-01ade1a58ac9 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1721 microversion: 2.1 time: 0.426172 Jun 23 22:38:35.658878 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 153/329] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:35 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1721 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:35.852851 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-f85a3248-b9eb-4f92-b841-10153646b9fe tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:35.854051 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-f85a3248-b9eb-4f92-b841-10153646b9fe tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] [instance: f2ce378d-902b-4621-84aa-51b964ae5fa4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:35.866161 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f85a3248-b9eb-4f92-b841-10153646b9fe tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:35.867499 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f85a3248-b9eb-4f92-b841-10153646b9fe tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:35.868451 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f85a3248-b9eb-4f92-b841-10153646b9fe tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:35.870075 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f85a3248-b9eb-4f92-b841-10153646b9fe tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:36.070959 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-2c66a97a-d020-4e05-926d-d2eecfbfb430 req-8b61ac63-c8bc-4029-9720-f985c1c8f2ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b", "tag": "e4f7fec0-2950-4a5c-8ce9-2b7668c8ae34"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:38:36.094379 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-2c66a97a-d020-4e05-926d-d2eecfbfb430 req-8b61ac63-c8bc-4029-9720-f985c1c8f2ec service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:36.097349 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-2c66a97a-d020-4e05-926d-d2eecfbfb430 req-8b61ac63-c8bc-4029-9720-f985c1c8f2ec service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:36.139861 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-2c66a97a-d020-4e05-926d-d2eecfbfb430 req-8b61ac63-c8bc-4029-9720-f985c1c8f2ec service nova] Creating event network-changed:e4f7fec0-2950-4a5c-8ce9-2b7668c8ae34 for instance 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b on hv-cinder-84617 Jun 23 22:38:36.146020 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-2c66a97a-d020-4e05-926d-d2eecfbfb430 req-8b61ac63-c8bc-4029-9720-f985c1c8f2ec service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080841 Jun 23 22:38:36.148510 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 154/330] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:38:36.244616 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-23f66414-e060-4a5e-be1b-232d2fb29895 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:36.245322 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-23f66414-e060-4a5e-be1b-232d2fb29895 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: 384878db-4705-4f7b-87ff-0f079208412f] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:36.259115 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-23f66414-e060-4a5e-be1b-232d2fb29895 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:36.259831 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-23f66414-e060-4a5e-be1b-232d2fb29895 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:36.260788 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-23f66414-e060-4a5e-be1b-232d2fb29895 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:36.261373 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-23f66414-e060-4a5e-be1b-232d2fb29895 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:36.600878 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-23f66414-e060-4a5e-be1b-232d2fb29895 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:36.607900 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:38:36.615439 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-23f66414-e060-4a5e-be1b-232d2fb29895 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f" status: 200 len: 1237 microversion: 2.1 time: 0.375881 Jun 23 22:38:36.616626 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 155/331] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:36 2022] GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f => generated 1237 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:38:36.629933 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-fdc3dc05-144b-4581-8f1b-d3a1959aaa17 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:36.638040 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-fdc3dc05-144b-4581-8f1b-d3a1959aaa17 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:36.658138 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fdc3dc05-144b-4581-8f1b-d3a1959aaa17 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:36.658973 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fdc3dc05-144b-4581-8f1b-d3a1959aaa17 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:36.660762 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fdc3dc05-144b-4581-8f1b-d3a1959aaa17 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:36.661439 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fdc3dc05-144b-4581-8f1b-d3a1959aaa17 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:36.689217 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-f85a3248-b9eb-4f92-b841-10153646b9fe tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f24b9b6f2d45c4907ce8cb419ab4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bc6b504b764fe6b3f892e2a8a88a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:36.697326 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-f85a3248-b9eb-4f92-b841-10153646b9fe tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] 10.222.0.43 "GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4" status: 200 len: 1464 microversion: 2.1 time: 0.849160 Jun 23 22:38:36.711632 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 177/332] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:35 2022] GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4 => generated 1464 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:36.711632 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-87192e50-a5f7-498e-9c69-96403c32d279 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:36.711632 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-87192e50-a5f7-498e-9c69-96403c32d279 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:36.730851 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-87192e50-a5f7-498e-9c69-96403c32d279 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:36.731338 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-87192e50-a5f7-498e-9c69-96403c32d279 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:36.749475 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-87192e50-a5f7-498e-9c69-96403c32d279 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:36.750217 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-87192e50-a5f7-498e-9c69-96403c32d279 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:36.952013 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-fdc3dc05-144b-4581-8f1b-d3a1959aaa17 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:36.959873 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-fdc3dc05-144b-4581-8f1b-d3a1959aaa17 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1370 microversion: 2.1 time: 0.342000 Jun 23 22:38:36.963507 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 156/333] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:36 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1370 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:36.975366 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-25353ff9-81a2-4ee8-9255-5aeec943ba58 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:36.976151 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-25353ff9-81a2-4ee8-9255-5aeec943ba58 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] [instance: f2ce378d-902b-4621-84aa-51b964ae5fa4] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:36.998152 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-87192e50-a5f7-498e-9c69-96403c32d279 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:37.005539 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-25353ff9-81a2-4ee8-9255-5aeec943ba58 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:37.006003 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-25353ff9-81a2-4ee8-9255-5aeec943ba58 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:37.006794 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-25353ff9-81a2-4ee8-9255-5aeec943ba58 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:37.007254 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-25353ff9-81a2-4ee8-9255-5aeec943ba58 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:37.013101 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-87192e50-a5f7-498e-9c69-96403c32d279 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1721 microversion: 2.1 time: 0.306633 Jun 23 22:38:37.013680 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 178/334] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:36 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1721 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:37.061854 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-25353ff9-81a2-4ee8-9255-5aeec943ba58 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] [instance: f2ce378d-902b-4621-84aa-51b964ae5fa4] Going to try to terminate instance {{(pid=124358) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:38:37.229870 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-25353ff9-81a2-4ee8-9255-5aeec943ba58 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4" status: 204 len: 0 microversion: 2.1 time: 0.264091 Jun 23 22:38:37.232806 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 157/335] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 23 22:38:36 2022] DELETE /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 22:38:37.242324 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-7cebc0de-df1b-4aeb-a6e4-874368a30e37 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:37.243308 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-7cebc0de-df1b-4aeb-a6e4-874368a30e37 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] [instance: f2ce378d-902b-4621-84aa-51b964ae5fa4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:37.250279 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7cebc0de-df1b-4aeb-a6e4-874368a30e37 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:37.251173 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7cebc0de-df1b-4aeb-a6e4-874368a30e37 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:37.252147 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7cebc0de-df1b-4aeb-a6e4-874368a30e37 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:37.252783 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7cebc0de-df1b-4aeb-a6e4-874368a30e37 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:37.491203 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-7cebc0de-df1b-4aeb-a6e4-874368a30e37 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f24b9b6f2d45c4907ce8cb419ab4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bc6b504b764fe6b3f892e2a8a88a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:37.517531 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-7cebc0de-df1b-4aeb-a6e4-874368a30e37 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] 10.222.0.43 "GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4" status: 200 len: 1470 microversion: 2.1 time: 0.279721 Jun 23 22:38:37.519410 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 179/336] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:37 2022] GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4 => generated 1470 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:37.643102 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e0e83dc3-43f3-4abb-9aeb-0d7cbcde982b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:37.645477 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e0e83dc3-43f3-4abb-9aeb-0d7cbcde982b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: 384878db-4705-4f7b-87ff-0f079208412f] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:37.669691 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e0e83dc3-43f3-4abb-9aeb-0d7cbcde982b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:37.670233 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e0e83dc3-43f3-4abb-9aeb-0d7cbcde982b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:37.671132 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e0e83dc3-43f3-4abb-9aeb-0d7cbcde982b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:37.685339 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e0e83dc3-43f3-4abb-9aeb-0d7cbcde982b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:37.780531 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e0e83dc3-43f3-4abb-9aeb-0d7cbcde982b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:37.792422 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e0e83dc3-43f3-4abb-9aeb-0d7cbcde982b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f" status: 200 len: 1237 microversion: 2.1 time: 0.161084 Jun 23 22:38:37.795657 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 158/337] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:37 2022] GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f => generated 1237 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:37.985073 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-adc928fc-d2ef-411a-a999-ee19740e76d9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:37.985796 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-adc928fc-d2ef-411a-a999-ee19740e76d9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:37.997655 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-adc928fc-d2ef-411a-a999-ee19740e76d9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:38.000273 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-adc928fc-d2ef-411a-a999-ee19740e76d9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:38.001071 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-adc928fc-d2ef-411a-a999-ee19740e76d9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:38.003979 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-adc928fc-d2ef-411a-a999-ee19740e76d9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:38.030628 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-6dcbfa6c-5b5a-4b17-b7fc-c2c0bb3132a6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:38.031258 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-6dcbfa6c-5b5a-4b17-b7fc-c2c0bb3132a6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:38.042251 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6dcbfa6c-5b5a-4b17-b7fc-c2c0bb3132a6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:38.045439 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6dcbfa6c-5b5a-4b17-b7fc-c2c0bb3132a6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:38.051601 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6dcbfa6c-5b5a-4b17-b7fc-c2c0bb3132a6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:38.052359 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6dcbfa6c-5b5a-4b17-b7fc-c2c0bb3132a6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:38.288080 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-adc928fc-d2ef-411a-a999-ee19740e76d9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:38.307836 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-adc928fc-d2ef-411a-a999-ee19740e76d9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1370 microversion: 2.1 time: 0.331602 Jun 23 22:38:38.309120 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 180/338] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:37 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1370 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:38.434561 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-6dcbfa6c-5b5a-4b17-b7fc-c2c0bb3132a6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:38.445442 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-6dcbfa6c-5b5a-4b17-b7fc-c2c0bb3132a6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1721 microversion: 2.1 time: 0.418466 Jun 23 22:38:38.457280 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 159/339] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:38 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1721 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:38:38.547227 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-ed7fcfca-a995-493d-a5f6-1b0ec7896281 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:38.548037 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-ed7fcfca-a995-493d-a5f6-1b0ec7896281 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] [instance: f2ce378d-902b-4621-84aa-51b964ae5fa4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:38.550245 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell0:SELECT=10 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:38:38.556299 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ed7fcfca-a995-493d-a5f6-1b0ec7896281 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:38.556845 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ed7fcfca-a995-493d-a5f6-1b0ec7896281 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:38.557695 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ed7fcfca-a995-493d-a5f6-1b0ec7896281 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:38.558277 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ed7fcfca-a995-493d-a5f6-1b0ec7896281 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:38.816565 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a1597f7b-0f80-4672-b2d4-9b3bb62d2753 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:38.816565 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-a1597f7b-0f80-4672-b2d4-9b3bb62d2753 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: 384878db-4705-4f7b-87ff-0f079208412f] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:38.832311 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a1597f7b-0f80-4672-b2d4-9b3bb62d2753 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:38.832753 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a1597f7b-0f80-4672-b2d4-9b3bb62d2753 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:38.833520 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a1597f7b-0f80-4672-b2d4-9b3bb62d2753 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:38.833944 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a1597f7b-0f80-4672-b2d4-9b3bb62d2753 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:38.865271 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-ed7fcfca-a995-493d-a5f6-1b0ec7896281 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f24b9b6f2d45c4907ce8cb419ab4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bc6b504b764fe6b3f892e2a8a88a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:38.905658 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-ed7fcfca-a995-493d-a5f6-1b0ec7896281 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] 10.222.0.43 "GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4" status: 200 len: 1470 microversion: 2.1 time: 0.372960 Jun 23 22:38:38.921302 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 181/340] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:38 2022] GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4 => generated 1470 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:39.077398 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-a1597f7b-0f80-4672-b2d4-9b3bb62d2753 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:39.085453 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-a1597f7b-0f80-4672-b2d4-9b3bb62d2753 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f" status: 200 len: 1237 microversion: 2.1 time: 0.275056 Jun 23 22:38:39.086047 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 160/341] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:38 2022] GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f => generated 1237 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:39.297895 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-9a4d42e8-c840-4c3e-85e6-0fef1be3b97e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Action: 'create', calling method: .version_select at 0x7fb719ad2d30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-932418013", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEkQiBiuCO411J+wVJdE/u9EhGDRgZyOFejTxpyiQZqlwCoUSAWTLRbY74W30IUXZFsVTSzLQyyeZYRlCHSlrVvOqPv1gyVCI8ugz80hKZxjWyWV8X2PCMYSzT3G2lwX9g=="}} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:38:39.315513 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-9a4d42e8-c840-4c3e-85e6-0fef1be3b97e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Getting quotas for project 1eb4b659032e4ec09a16c45b29d609f0. Resources: {'key_pairs'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:38:39.322159 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-9a4d42e8-c840-4c3e-85e6-0fef1be3b97e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Getting quotas for user f523b529906f4fa989d0e836d6a08944 and project 1eb4b659032e4ec09a16c45b29d609f0. Resources: {'key_pairs'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:38:39.325807 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e79271a0-ea31-4eb6-8e0d-d203929ebd55 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:39.326707 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e79271a0-ea31-4eb6-8e0d-d203929ebd55 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:39.341263 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e79271a0-ea31-4eb6-8e0d-d203929ebd55 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:39.341914 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e79271a0-ea31-4eb6-8e0d-d203929ebd55 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:39.342824 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e79271a0-ea31-4eb6-8e0d-d203929ebd55 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:39.344530 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e79271a0-ea31-4eb6-8e0d-d203929ebd55 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:39.352165 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-9a4d42e8-c840-4c3e-85e6-0fef1be3b97e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.333016 Jun 23 22:38:39.353448 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 182/342] 10.222.0.43 () {60 vars in 1158 bytes} [Thu Jun 23 22:38:39 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:38:39.469871 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-d9420a84-ac38-4fc4-ae07-0d401f7be809 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:39.470812 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-d9420a84-ac38-4fc4-ae07-0d401f7be809 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:39.497846 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d9420a84-ac38-4fc4-ae07-0d401f7be809 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:39.498294 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d9420a84-ac38-4fc4-ae07-0d401f7be809 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:39.506575 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d9420a84-ac38-4fc4-ae07-0d401f7be809 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:39.507057 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d9420a84-ac38-4fc4-ae07-0d401f7be809 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:39.572673 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e79271a0-ea31-4eb6-8e0d-d203929ebd55 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:39.585401 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e79271a0-ea31-4eb6-8e0d-d203929ebd55 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1370 microversion: 2.1 time: 0.264494 Jun 23 22:38:39.587560 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 161/343] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:39 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1370 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:38:39.936502 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-d9420a84-ac38-4fc4-ae07-0d401f7be809 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:39.983147 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-d9420a84-ac38-4fc4-ae07-0d401f7be809 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1698 microversion: 2.1 time: 0.522039 Jun 23 22:38:39.985028 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 183/344] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:39 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1698 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:40.004781 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-1b4720e2-974f-40f4-a81b-0471486890a6 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:40.005409 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-1b4720e2-974f-40f4-a81b-0471486890a6 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] [instance: f2ce378d-902b-4621-84aa-51b964ae5fa4] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:40.011096 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-9c571735-4957-4e32-8f9c-b29dfe5e454d tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:38:40.031540 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9c571735-4957-4e32-8f9c-b29dfe5e454d tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:40.031999 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9c571735-4957-4e32-8f9c-b29dfe5e454d tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:40.064981 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1b4720e2-974f-40f4-a81b-0471486890a6 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:40.067425 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1b4720e2-974f-40f4-a81b-0471486890a6 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:40.068475 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1b4720e2-974f-40f4-a81b-0471486890a6 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:40.070560 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1b4720e2-974f-40f4-a81b-0471486890a6 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:40.097467 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-9c571735-4957-4e32-8f9c-b29dfe5e454d tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Going to try to start instance {{(pid=124357) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 23 22:38:40.352266 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-9c571735-4957-4e32-8f9c-b29dfe5e454d tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "POST /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1/action" status: 202 len: 0 microversion: 2.1 time: 0.345028 Jun 23 22:38:40.370138 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 184/345] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Jun 23 22:38:39 2022] POST /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1/action => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 22:38:40.382991 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-eab45386-0bd1-4703-804d-18c94dd791da tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:40.384362 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-eab45386-0bd1-4703-804d-18c94dd791da tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: 384878db-4705-4f7b-87ff-0f079208412f] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:40.393442 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-eab45386-0bd1-4703-804d-18c94dd791da tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:40.394191 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-eab45386-0bd1-4703-804d-18c94dd791da tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:40.395779 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-eab45386-0bd1-4703-804d-18c94dd791da tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:40.396383 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-eab45386-0bd1-4703-804d-18c94dd791da tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:40.434218 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-1b4720e2-974f-40f4-a81b-0471486890a6 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f24b9b6f2d45c4907ce8cb419ab4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bc6b504b764fe6b3f892e2a8a88a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:40.447320 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-1b4720e2-974f-40f4-a81b-0471486890a6 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] 10.222.0.43 "GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4" status: 200 len: 1470 microversion: 2.1 time: 0.487678 Jun 23 22:38:40.448050 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 162/346] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:39 2022] GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4 => generated 1470 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:40.471333 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e2298aea-27dc-4a82-8c7c-cb6db80bb642 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:40.472364 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e2298aea-27dc-4a82-8c7c-cb6db80bb642 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:40.486151 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e2298aea-27dc-4a82-8c7c-cb6db80bb642 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:40.487964 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e2298aea-27dc-4a82-8c7c-cb6db80bb642 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:40.490574 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e2298aea-27dc-4a82-8c7c-cb6db80bb642 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:40.491375 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e2298aea-27dc-4a82-8c7c-cb6db80bb642 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:40.512601 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-eab45386-0bd1-4703-804d-18c94dd791da tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:40.522473 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-eab45386-0bd1-4703-804d-18c94dd791da tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f" status: 200 len: 1293 microversion: 2.1 time: 0.149170 Jun 23 22:38:40.528627 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 185/347] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:40 2022] GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f => generated 1293 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:40.604199 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-5d425dde-a828-4968-b014-9924cca908ee tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:40.604823 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-5d425dde-a828-4968-b014-9924cca908ee tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:40.619683 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5d425dde-a828-4968-b014-9924cca908ee tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:40.620280 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5d425dde-a828-4968-b014-9924cca908ee tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:40.622297 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5d425dde-a828-4968-b014-9924cca908ee tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:40.622746 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5d425dde-a828-4968-b014-9924cca908ee tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:41.150370 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-5d425dde-a828-4968-b014-9924cca908ee tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:41.163180 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-5d425dde-a828-4968-b014-9924cca908ee tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1370 microversion: 2.1 time: 0.562986 Jun 23 22:38:41.178965 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 186/348] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:40 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1370 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:41.348190 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e2298aea-27dc-4a82-8c7c-cb6db80bb642 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:41.359614 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e2298aea-27dc-4a82-8c7c-cb6db80bb642 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1707 microversion: 2.1 time: 0.899393 Jun 23 22:38:41.361783 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 163/349] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:40 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1707 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:41.466667 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-f6c88ef4-c65d-4d87-8f3c-277fa13f0f41 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:41.467873 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-f6c88ef4-c65d-4d87-8f3c-277fa13f0f41 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] [instance: f2ce378d-902b-4621-84aa-51b964ae5fa4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:41.484255 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f6c88ef4-c65d-4d87-8f3c-277fa13f0f41 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:41.485129 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f6c88ef4-c65d-4d87-8f3c-277fa13f0f41 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:41.487662 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f6c88ef4-c65d-4d87-8f3c-277fa13f0f41 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:41.488288 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f6c88ef4-c65d-4d87-8f3c-277fa13f0f41 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:41.545151 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-7ffb2458-1ae8-48e1-9998-e8a51c1fa789 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:41.545787 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-7ffb2458-1ae8-48e1-9998-e8a51c1fa789 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: 384878db-4705-4f7b-87ff-0f079208412f] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:41.563445 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7ffb2458-1ae8-48e1-9998-e8a51c1fa789 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:41.564317 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7ffb2458-1ae8-48e1-9998-e8a51c1fa789 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:41.567271 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7ffb2458-1ae8-48e1-9998-e8a51c1fa789 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:41.570028 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7ffb2458-1ae8-48e1-9998-e8a51c1fa789 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:42.077149 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-7ffb2458-1ae8-48e1-9998-e8a51c1fa789 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:42.087035 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-7ffb2458-1ae8-48e1-9998-e8a51c1fa789 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f" status: 200 len: 1299 microversion: 2.1 time: 0.550891 Jun 23 22:38:42.087740 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 164/350] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:41 2022] GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f => generated 1299 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:42.184235 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-17991bf3-0949-4357-bf5b-1938799aa5d8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:42.184848 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-17991bf3-0949-4357-bf5b-1938799aa5d8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:42.190776 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-17991bf3-0949-4357-bf5b-1938799aa5d8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:42.191265 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-17991bf3-0949-4357-bf5b-1938799aa5d8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:42.192104 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-17991bf3-0949-4357-bf5b-1938799aa5d8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:42.192544 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-17991bf3-0949-4357-bf5b-1938799aa5d8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:42.389381 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-f6c88ef4-c65d-4d87-8f3c-277fa13f0f41 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f24b9b6f2d45c4907ce8cb419ab4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bc6b504b764fe6b3f892e2a8a88a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:42.396862 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-f6c88ef4-c65d-4d87-8f3c-277fa13f0f41 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] 10.222.0.43 "GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4" status: 200 len: 1470 microversion: 2.1 time: 0.935159 Jun 23 22:38:42.397354 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 187/351] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:41 2022] GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4 => generated 1470 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:42.403490 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-e4fca6fd-ad3a-4de0-b33d-1c5c8fb922e6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:42.404368 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-e4fca6fd-ad3a-4de0-b33d-1c5c8fb922e6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:42.410169 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-e4fca6fd-ad3a-4de0-b33d-1c5c8fb922e6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:42.410843 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-e4fca6fd-ad3a-4de0-b33d-1c5c8fb922e6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:42.411725 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-e4fca6fd-ad3a-4de0-b33d-1c5c8fb922e6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:42.412245 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-e4fca6fd-ad3a-4de0-b33d-1c5c8fb922e6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:42.773191 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-17991bf3-0949-4357-bf5b-1938799aa5d8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:42.784261 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-17991bf3-0949-4357-bf5b-1938799aa5d8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1370 microversion: 2.1 time: 0.604055 Jun 23 22:38:42.797513 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 165/352] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:42 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1370 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:42.885050 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-e4fca6fd-ad3a-4de0-b33d-1c5c8fb922e6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:42.904721 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-e4fca6fd-ad3a-4de0-b33d-1c5c8fb922e6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1707 microversion: 2.1 time: 0.503537 Jun 23 22:38:42.905509 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 188/353] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:42 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1707 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:43.109323 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-373127c0-aea7-4ece-8180-a1b081b0d268 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:43.110344 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-373127c0-aea7-4ece-8180-a1b081b0d268 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: 384878db-4705-4f7b-87ff-0f079208412f] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:43.122702 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-373127c0-aea7-4ece-8180-a1b081b0d268 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:43.124111 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-373127c0-aea7-4ece-8180-a1b081b0d268 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:43.125264 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-373127c0-aea7-4ece-8180-a1b081b0d268 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:43.126085 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-373127c0-aea7-4ece-8180-a1b081b0d268 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:43.154148 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [req-85bce109-bda2-4102-9296-d6a7a3f72e5c req-63e940b4-5a11-4e63-9fd9-dd7fdeb1b35f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2ce378d-902b-4621-84aa-51b964ae5fa4", "name": "network-vif-deleted", "tag": "eef93757-ff5c-42de-bec1-9578ae8af3ca"}]} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:38:43.163631 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-85bce109-bda2-4102-9296-d6a7a3f72e5c req-63e940b4-5a11-4e63-9fd9-dd7fdeb1b35f service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:43.164080 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-85bce109-bda2-4102-9296-d6a7a3f72e5c req-63e940b4-5a11-4e63-9fd9-dd7fdeb1b35f service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:43.175568 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:38:43.209300 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.compute.server_external_events [req-85bce109-bda2-4102-9296-d6a7a3f72e5c req-63e940b4-5a11-4e63-9fd9-dd7fdeb1b35f service nova] Creating event network-vif-deleted:eef93757-ff5c-42de-bec1-9578ae8af3ca for instance f2ce378d-902b-4621-84aa-51b964ae5fa4 on hv-cinder-84617 Jun 23 22:38:43.215623 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [req-85bce109-bda2-4102-9296-d6a7a3f72e5c req-63e940b4-5a11-4e63-9fd9-dd7fdeb1b35f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065103 Jun 23 22:38:43.216526 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 189/354] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:38:43.266536 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-373127c0-aea7-4ece-8180-a1b081b0d268 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:43.279069 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-373127c0-aea7-4ece-8180-a1b081b0d268 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f" status: 200 len: 1299 microversion: 2.1 time: 0.178241 Jun 23 22:38:43.282642 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 166/355] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:43 2022] GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f => generated 1299 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:43.416783 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-dddf4b31-8c17-4502-a4b8-80ff81d06d25 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:43.418016 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-dddf4b31-8c17-4502-a4b8-80ff81d06d25 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] [instance: f2ce378d-902b-4621-84aa-51b964ae5fa4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:43.432825 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-dddf4b31-8c17-4502-a4b8-80ff81d06d25 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:43.434483 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-dddf4b31-8c17-4502-a4b8-80ff81d06d25 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:43.435523 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-dddf4b31-8c17-4502-a4b8-80ff81d06d25 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:43.440158 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-dddf4b31-8c17-4502-a4b8-80ff81d06d25 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:43.647519 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-dddf4b31-8c17-4502-a4b8-80ff81d06d25 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f24b9b6f2d45c4907ce8cb419ab4a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7bc6b504b764fe6b3f892e2a8a88a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:43.661898 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-dddf4b31-8c17-4502-a4b8-80ff81d06d25 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] 10.222.0.43 "GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4" status: 200 len: 1300 microversion: 2.1 time: 0.251248 Jun 23 22:38:43.662829 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 190/356] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:43 2022] GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4 => generated 1300 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:43.803079 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f0e2d7b7-c5ee-407e-8bdf-15a356304fe5 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:43.803791 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-f0e2d7b7-c5ee-407e-8bdf-15a356304fe5 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:43.813305 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f0e2d7b7-c5ee-407e-8bdf-15a356304fe5 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:43.813874 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f0e2d7b7-c5ee-407e-8bdf-15a356304fe5 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:43.815032 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f0e2d7b7-c5ee-407e-8bdf-15a356304fe5 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:43.815657 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f0e2d7b7-c5ee-407e-8bdf-15a356304fe5 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:43.936271 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-9eb79f1b-9cea-4aa0-861a-ec0d4264340f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:43.938148 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-9eb79f1b-9cea-4aa0-861a-ec0d4264340f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:43.960092 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9eb79f1b-9cea-4aa0-861a-ec0d4264340f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:43.960538 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9eb79f1b-9cea-4aa0-861a-ec0d4264340f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:43.966211 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9eb79f1b-9cea-4aa0-861a-ec0d4264340f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:43.966658 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9eb79f1b-9cea-4aa0-861a-ec0d4264340f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:44.876957 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=4 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:38:44.886062 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-9eb79f1b-9cea-4aa0-861a-ec0d4264340f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:44.889179 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f0e2d7b7-c5ee-407e-8bdf-15a356304fe5 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:44.905311 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-9eb79f1b-9cea-4aa0-861a-ec0d4264340f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1711 microversion: 2.1 time: 0.986580 Jun 23 22:38:44.906906 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 191/357] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:43 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1711 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:38:44.914265 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f0e2d7b7-c5ee-407e-8bdf-15a356304fe5 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1370 microversion: 2.1 time: 1.115947 Jun 23 22:38:44.918602 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 167/358] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:43 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1370 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:44.927939 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-5240951a-dd04-43ed-9c23-6e696f19d562 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:44.928462 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-5240951a-dd04-43ed-9c23-6e696f19d562 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: 384878db-4705-4f7b-87ff-0f079208412f] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:44.930354 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-3d4da6c3-c917-4a11-bab5-649813b19ae7 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:44.931001 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-3d4da6c3-c917-4a11-bab5-649813b19ae7 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] [instance: f2ce378d-902b-4621-84aa-51b964ae5fa4] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:44.935766 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:38:44.955043 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3d4da6c3-c917-4a11-bab5-649813b19ae7 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:44.955520 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5240951a-dd04-43ed-9c23-6e696f19d562 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:44.956650 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5240951a-dd04-43ed-9c23-6e696f19d562 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:44.957284 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3d4da6c3-c917-4a11-bab5-649813b19ae7 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:44.958331 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5240951a-dd04-43ed-9c23-6e696f19d562 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:44.958687 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5240951a-dd04-43ed-9c23-6e696f19d562 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:44.959750 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3d4da6c3-c917-4a11-bab5-649813b19ae7 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:44.960180 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3d4da6c3-c917-4a11-bab5-649813b19ae7 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:45.001531 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-3d4da6c3-c917-4a11-bab5-649813b19ae7 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] HTTP exception thrown: Instance f2ce378d-902b-4621-84aa-51b964ae5fa4 could not be found. Jun 23 22:38:45.003091 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-3d4da6c3-c917-4a11-bab5-649813b19ae7 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Request method failure captured: Jun 23 22:38:45.003091 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: request: GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4 HTTP/1.1 Jun 23 22:38:45.003091 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept: application/json Jun 23 22:38:45.003091 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Jun 23 22:38:45.003091 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Connection: close Jun 23 22:38:45.003091 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Length: 0 Jun 23 22:38:45.003091 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Type: application/json Jun 23 22:38:45.003091 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Host: 10.222.0.43 Jun 23 22:38:45.003091 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Jun 23 22:38:45.003091 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.9 Jun 23 22:38:45.003091 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABitOtJpqnm6CCyr8A7CYeigUQx6u0l58X4yzTPYY44PObfPfLb5TmBVictRgsMm2VRe9eDs-V6JkNhMWDKkl-KxmiWiFhwptl38firLJDKbKesWVMUpVK7TXfgmSoPp1NxuZhgnnFH7TgRProT-o9dg65xCKO6gd8a0B06k6rd-_ENdyU Jun 23 22:38:45.003091 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Jun 23 22:38:45.003091 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Jun 23 22:38:45.003091 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Jun 23 22:38:45.003091 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Jun 23 22:38:45.003091 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Jun 23 22:38:45.003091 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Jun 23 22:38:45.003091 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Id: f7bc6b504b764fe6b3f892e2a8a88a05 Jun 23 22:38:45.003091 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-VolumesNegativeTest-483753075 Jun 23 22:38:45.003091 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Role: reader,member Jun 23 22:38:45.003091 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Roles: reader,member Jun 23 22:38:45.004699 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f7bc6b504b764fe6b3f892e2a8a88a05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f7bc6b504b764fe6b3f892e2a8a88a05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f7bc6b504b764fe6b3f892e2a8a88a05", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f7bc6b504b764fe6b3f892e2a8a88a05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:38:45.004699 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-VolumesNegativeTest-483753075 Jun 23 22:38:45.004699 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Id: f7bc6b504b764fe6b3f892e2a8a88a05 Jun 23 22:38:45.004699 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-VolumesNegativeTest-483753075 Jun 23 22:38:45.004699 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User: tempest-VolumesNegativeTest-483753075-project Jun 23 22:38:45.004699 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Jun 23 22:38:45.004699 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Jun 23 22:38:45.004699 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Id: 34f24b9b6f2d45c4907ce8cb419ab4a4 Jun 23 22:38:45.004699 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-VolumesNegativeTest-483753075-project Jun 23 22:38:45.004699 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: method: > Jun 23 22:38:45.004699 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: exception: Instance f2ce378d-902b-4621-84aa-51b964ae5fa4 could not be found. Jun 23 22:38:45.004699 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: action_args: {'id': 'f2ce378d-902b-4621-84aa-51b964ae5fa4'} Jun 23 22:38:45.009315 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:38:45.009315 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:38:45.009315 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:38:45.009315 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:38:45.009315 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:38:45.009315 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:38:45.009315 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:38:45.009315 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:38:45.009315 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:38:45.009315 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:38:45.009315 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2ce378d-902b-4621-84aa-51b964ae5fa4 could not be found. Jun 23 22:38:45.009315 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:38:45.009315 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:38:45.009315 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:38:45.009315 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:38:45.009315 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:38:45.009315 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:38:45.009315 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:38:45.009315 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:38:45.009315 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:38:45.010528 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:38:45.010528 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:38:45.010528 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:38:45.010528 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:38:45.010528 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:38:45.010528 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:38:45.010528 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:38:45.010528 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2ce378d-902b-4621-84aa-51b964ae5fa4 could not be found. Jun 23 22:38:45.010528 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:38:45.010528 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:38:45.010528 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:38:45.010528 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:38:45.010528 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:38:45.010528 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:38:45.010528 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:38:45.010528 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:38:45.010528 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2ce378d-902b-4621-84aa-51b964ae5fa4 could not be found. Jun 23 22:38:45.010528 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:38:45.012882 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-3d4da6c3-c917-4a11-bab5-649813b19ae7 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] Returning 404 to user: Instance f2ce378d-902b-4621-84aa-51b964ae5fa4 could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:38:45.012882 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-3d4da6c3-c917-4a11-bab5-649813b19ae7 tempest-VolumesNegativeTest-483753075 tempest-VolumesNegativeTest-483753075-project] 10.222.0.43 "GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4" status: 404 len: 111 microversion: 2.1 time: 0.083577 Jun 23 22:38:45.012882 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 168/359] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:44 2022] GET /compute/v2.1/servers/f2ce378d-902b-4621-84aa-51b964ae5fa4 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:38:45.338297 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-5240951a-dd04-43ed-9c23-6e696f19d562 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:45.359441 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-5240951a-dd04-43ed-9c23-6e696f19d562 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f" status: 200 len: 1366 microversion: 2.1 time: 0.447732 Jun 23 22:38:45.370832 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 192/360] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:44 2022] GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f => generated 1366 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:45.937876 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d2eff7e7-6ac5-4594-9ad0-61d1acb8ddc2 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:45.938498 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-d2eff7e7-6ac5-4594-9ad0-61d1acb8ddc2 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:45.940955 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=14 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:38:45.955100 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d2eff7e7-6ac5-4594-9ad0-61d1acb8ddc2 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:45.973319 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d2eff7e7-6ac5-4594-9ad0-61d1acb8ddc2 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:45.974366 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d2eff7e7-6ac5-4594-9ad0-61d1acb8ddc2 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:45.977999 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d2eff7e7-6ac5-4594-9ad0-61d1acb8ddc2 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:46.101749 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [req-7fbb514f-c607-41e6-8b11-867ef50db265 req-d1a49626-929f-414e-93d7-26045327415c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "384878db-4705-4f7b-87ff-0f079208412f", "tag": "f64c1270-e6bb-4c22-97a6-eb4fedf23371"}]} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:38:46.117725 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-7fbb514f-c607-41e6-8b11-867ef50db265 req-d1a49626-929f-414e-93d7-26045327415c service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:46.118905 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-7fbb514f-c607-41e6-8b11-867ef50db265 req-d1a49626-929f-414e-93d7-26045327415c service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:46.137787 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.compute.server_external_events [req-7fbb514f-c607-41e6-8b11-867ef50db265 req-d1a49626-929f-414e-93d7-26045327415c service nova] Creating event network-changed:f64c1270-e6bb-4c22-97a6-eb4fedf23371 for instance 384878db-4705-4f7b-87ff-0f079208412f on hv-cinder-84617 Jun 23 22:38:46.155424 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [req-7fbb514f-c607-41e6-8b11-867ef50db265 req-d1a49626-929f-414e-93d7-26045327415c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068133 Jun 23 22:38:46.156535 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 193/361] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:38:46.378645 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-2f539d36-19d1-431a-bf7d-26ddd698cc23 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:46.380785 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-2f539d36-19d1-431a-bf7d-26ddd698cc23 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: 384878db-4705-4f7b-87ff-0f079208412f] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:46.393468 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2f539d36-19d1-431a-bf7d-26ddd698cc23 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:46.393929 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2f539d36-19d1-431a-bf7d-26ddd698cc23 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:46.403985 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2f539d36-19d1-431a-bf7d-26ddd698cc23 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:46.404622 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2f539d36-19d1-431a-bf7d-26ddd698cc23 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:46.592959 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d2eff7e7-6ac5-4594-9ad0-61d1acb8ddc2 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:46.603317 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d2eff7e7-6ac5-4594-9ad0-61d1acb8ddc2 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1370 microversion: 2.1 time: 0.670211 Jun 23 22:38:46.617043 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 169/362] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:45 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1370 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:46.701544 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-2f539d36-19d1-431a-bf7d-26ddd698cc23 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:46.710415 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-2f539d36-19d1-431a-bf7d-26ddd698cc23 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f" status: 200 len: 1366 microversion: 2.1 time: 0.335592 Jun 23 22:38:46.718107 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 194/363] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:46 2022] GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f => generated 1366 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:47.620265 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a1410176-6988-4f61-ac0a-ecae7442561a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:47.621975 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-a1410176-6988-4f61-ac0a-ecae7442561a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:47.631052 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a1410176-6988-4f61-ac0a-ecae7442561a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:47.632020 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a1410176-6988-4f61-ac0a-ecae7442561a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:47.633285 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a1410176-6988-4f61-ac0a-ecae7442561a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:47.633915 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a1410176-6988-4f61-ac0a-ecae7442561a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:47.730823 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-804685be-7a76-43a3-88e8-77fddc9d7b34 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:47.731641 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-804685be-7a76-43a3-88e8-77fddc9d7b34 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: 384878db-4705-4f7b-87ff-0f079208412f] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:47.738358 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-804685be-7a76-43a3-88e8-77fddc9d7b34 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:47.743422 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-804685be-7a76-43a3-88e8-77fddc9d7b34 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:47.744749 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-804685be-7a76-43a3-88e8-77fddc9d7b34 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:47.749082 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-804685be-7a76-43a3-88e8-77fddc9d7b34 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:47.910606 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-a1410176-6988-4f61-ac0a-ecae7442561a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:47.926800 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-a1410176-6988-4f61-ac0a-ecae7442561a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1370 microversion: 2.1 time: 0.310409 Jun 23 22:38:47.929341 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 170/364] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:47 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1370 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:47.961647 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-804685be-7a76-43a3-88e8-77fddc9d7b34 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:47.972071 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-804685be-7a76-43a3-88e8-77fddc9d7b34 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f" status: 200 len: 1366 microversion: 2.1 time: 0.246113 Jun 23 22:38:47.972649 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 195/365] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:47 2022] GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:48.946664 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-70fc2592-c092-49ad-bea8-80a1810973c0 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:48.947274 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-70fc2592-c092-49ad-bea8-80a1810973c0 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:48.964761 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-70fc2592-c092-49ad-bea8-80a1810973c0 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:48.966365 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-70fc2592-c092-49ad-bea8-80a1810973c0 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:48.967538 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-70fc2592-c092-49ad-bea8-80a1810973c0 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:48.968980 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-70fc2592-c092-49ad-bea8-80a1810973c0 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:48.992209 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-af123340-fc03-46c3-9ade-4ffbab7720b8 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:48.993580 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-af123340-fc03-46c3-9ade-4ffbab7720b8 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: 384878db-4705-4f7b-87ff-0f079208412f] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:48.999639 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:38:49.001948 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:38:49.018526 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-af123340-fc03-46c3-9ade-4ffbab7720b8 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:49.019476 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-af123340-fc03-46c3-9ade-4ffbab7720b8 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:49.026340 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-af123340-fc03-46c3-9ade-4ffbab7720b8 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:49.026642 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-af123340-fc03-46c3-9ade-4ffbab7720b8 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:49.256872 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-70fc2592-c092-49ad-bea8-80a1810973c0 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:49.272825 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-70fc2592-c092-49ad-bea8-80a1810973c0 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1370 microversion: 2.1 time: 0.329932 Jun 23 22:38:49.276816 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 171/366] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:48 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1370 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:49.285261 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-824bcb09-cb2d-4408-8780-771ad461c90f req-85948558-654e-4935-ac36-1fbe5873851c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b", "name": "network-vif-plugged", "status": "completed", "tag": "e4f7fec0-2950-4a5c-8ce9-2b7668c8ae34"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:38:49.308698 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-824bcb09-cb2d-4408-8780-771ad461c90f req-85948558-654e-4935-ac36-1fbe5873851c service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:49.309349 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-824bcb09-cb2d-4408-8780-771ad461c90f req-85948558-654e-4935-ac36-1fbe5873851c service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:49.333611 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell0:SELECT=4 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:38:49.340706 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-824bcb09-cb2d-4408-8780-771ad461c90f req-85948558-654e-4935-ac36-1fbe5873851c service nova] Creating event network-vif-plugged:e4f7fec0-2950-4a5c-8ce9-2b7668c8ae34 for instance 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b on hv-cinder-84617 Jun 23 22:38:49.349132 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-824bcb09-cb2d-4408-8780-771ad461c90f req-85948558-654e-4935-ac36-1fbe5873851c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068621 Jun 23 22:38:49.350842 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 172/367] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:38:49.398564 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-af123340-fc03-46c3-9ade-4ffbab7720b8 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:49.440193 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-af123340-fc03-46c3-9ade-4ffbab7720b8 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f" status: 200 len: 1366 microversion: 2.1 time: 0.454082 Jun 23 22:38:49.441247 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 196/368] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:48 2022] GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f => generated 1366 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:50.291918 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-ec8b4e35-8b53-4c51-a121-1d8dea74b1cd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:50.293192 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-ec8b4e35-8b53-4c51-a121-1d8dea74b1cd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:50.299400 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ec8b4e35-8b53-4c51-a121-1d8dea74b1cd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:50.299834 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ec8b4e35-8b53-4c51-a121-1d8dea74b1cd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:50.300593 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ec8b4e35-8b53-4c51-a121-1d8dea74b1cd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:50.301015 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ec8b4e35-8b53-4c51-a121-1d8dea74b1cd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:50.457663 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-a7fd98ca-ea97-4f5c-8e77-0335ba9f240c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:50.458280 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-a7fd98ca-ea97-4f5c-8e77-0335ba9f240c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: 384878db-4705-4f7b-87ff-0f079208412f] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:50.464202 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a7fd98ca-ea97-4f5c-8e77-0335ba9f240c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:50.464862 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a7fd98ca-ea97-4f5c-8e77-0335ba9f240c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:50.465641 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a7fd98ca-ea97-4f5c-8e77-0335ba9f240c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:50.466068 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a7fd98ca-ea97-4f5c-8e77-0335ba9f240c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:50.474115 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ec8b4e35-8b53-4c51-a121-1d8dea74b1cd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:50.483502 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-ec8b4e35-8b53-4c51-a121-1d8dea74b1cd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1370 microversion: 2.1 time: 0.196096 Jun 23 22:38:50.493225 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 173/369] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:50 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1370 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:38:50.681603 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-a7fd98ca-ea97-4f5c-8e77-0335ba9f240c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:50.689945 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-a7fd98ca-ea97-4f5c-8e77-0335ba9f240c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f" status: 200 len: 1366 microversion: 2.1 time: 0.236083 Jun 23 22:38:50.690732 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 197/370] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:50 2022] GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:38:51.378365 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-cefeba41-252d-491d-a0db-4a8399980587 req-f8a0df93-f082-404d-ad68-af87a5691307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "384878db-4705-4f7b-87ff-0f079208412f", "name": "network-vif-plugged", "status": "completed", "tag": "f64c1270-e6bb-4c22-97a6-eb4fedf23371"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:38:51.389084 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-cefeba41-252d-491d-a0db-4a8399980587 req-f8a0df93-f082-404d-ad68-af87a5691307 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:51.389522 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-cefeba41-252d-491d-a0db-4a8399980587 req-f8a0df93-f082-404d-ad68-af87a5691307 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:51.405014 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-cefeba41-252d-491d-a0db-4a8399980587 req-f8a0df93-f082-404d-ad68-af87a5691307 service nova] Creating event network-vif-plugged:f64c1270-e6bb-4c22-97a6-eb4fedf23371 for instance 384878db-4705-4f7b-87ff-0f079208412f on hv-cinder-84617 Jun 23 22:38:51.411344 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-cefeba41-252d-491d-a0db-4a8399980587 req-f8a0df93-f082-404d-ad68-af87a5691307 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037054 Jun 23 22:38:51.412520 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 174/371] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:38:51.501110 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-92ea9261-78ee-4cad-b033-a662ed05dbac tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:51.501726 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-92ea9261-78ee-4cad-b033-a662ed05dbac tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:51.510650 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-92ea9261-78ee-4cad-b033-a662ed05dbac tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:51.511142 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-92ea9261-78ee-4cad-b033-a662ed05dbac tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:51.512021 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-92ea9261-78ee-4cad-b033-a662ed05dbac tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:51.518258 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-92ea9261-78ee-4cad-b033-a662ed05dbac tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:51.708841 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c1d45189-e5f0-492f-bd86-4713a5ee07c4 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:51.709683 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c1d45189-e5f0-492f-bd86-4713a5ee07c4 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: 384878db-4705-4f7b-87ff-0f079208412f] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:51.725262 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c1d45189-e5f0-492f-bd86-4713a5ee07c4 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:51.727489 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c1d45189-e5f0-492f-bd86-4713a5ee07c4 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:51.728640 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c1d45189-e5f0-492f-bd86-4713a5ee07c4 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:51.729361 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c1d45189-e5f0-492f-bd86-4713a5ee07c4 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:51.788486 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-92ea9261-78ee-4cad-b033-a662ed05dbac tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:51.797952 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-92ea9261-78ee-4cad-b033-a662ed05dbac tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1370 microversion: 2.1 time: 0.300651 Jun 23 22:38:51.807119 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 198/372] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:51 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1370 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:51.979882 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c1d45189-e5f0-492f-bd86-4713a5ee07c4 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:51.990204 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c1d45189-e5f0-492f-bd86-4713a5ee07c4 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f" status: 200 len: 1366 microversion: 2.1 time: 0.285651 Jun 23 22:38:51.990781 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 175/373] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:51 2022] GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f => generated 1366 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:38:52.829471 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-1038a637-7726-4012-bb6d-8a7282632c34 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:52.831099 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-1038a637-7726-4012-bb6d-8a7282632c34 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:52.840791 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1038a637-7726-4012-bb6d-8a7282632c34 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:52.841771 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1038a637-7726-4012-bb6d-8a7282632c34 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:52.847148 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1038a637-7726-4012-bb6d-8a7282632c34 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:52.847825 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1038a637-7726-4012-bb6d-8a7282632c34 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:53.012704 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-ac53fa82-e968-48be-a2a4-123a2274205b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:53.015135 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-ac53fa82-e968-48be-a2a4-123a2274205b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: 384878db-4705-4f7b-87ff-0f079208412f] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:53.023055 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ac53fa82-e968-48be-a2a4-123a2274205b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:53.023743 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ac53fa82-e968-48be-a2a4-123a2274205b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:53.024658 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ac53fa82-e968-48be-a2a4-123a2274205b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:53.025384 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ac53fa82-e968-48be-a2a4-123a2274205b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:53.046903 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-1038a637-7726-4012-bb6d-8a7282632c34 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:53.056711 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-1038a637-7726-4012-bb6d-8a7282632c34 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1564 microversion: 2.1 time: 0.235645 Jun 23 22:38:53.063984 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 199/374] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:52 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1564 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:53.075068 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-899b66f3-ff3b-46fb-bebe-2749078dc418 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:53.075659 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-899b66f3-ff3b-46fb-bebe-2749078dc418 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:53.082284 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-899b66f3-ff3b-46fb-bebe-2749078dc418 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:53.082889 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-899b66f3-ff3b-46fb-bebe-2749078dc418 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:53.084068 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-899b66f3-ff3b-46fb-bebe-2749078dc418 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:53.084657 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-899b66f3-ff3b-46fb-bebe-2749078dc418 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:53.233316 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-899b66f3-ff3b-46fb-bebe-2749078dc418 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.163746 Jun 23 22:38:53.233911 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 200/375] 10.222.0.43 () {58 vars in 1274 bytes} [Thu Jun 23 22:38:53 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b/os-interface => generated 284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:38:53.249117 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ac53fa82-e968-48be-a2a4-123a2274205b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:53.264327 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-ac53fa82-e968-48be-a2a4-123a2274205b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f" status: 200 len: 1366 microversion: 2.1 time: 0.259271 Jun 23 22:38:53.265216 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 176/376] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:53 2022] GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:54.283739 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-336e1208-3ff3-424c-9ec1-99be61af0e55 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:54.284390 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-336e1208-3ff3-424c-9ec1-99be61af0e55 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: 384878db-4705-4f7b-87ff-0f079208412f] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:54.304305 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-336e1208-3ff3-424c-9ec1-99be61af0e55 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:54.304771 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-336e1208-3ff3-424c-9ec1-99be61af0e55 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:54.305815 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-336e1208-3ff3-424c-9ec1-99be61af0e55 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:54.306357 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-336e1208-3ff3-424c-9ec1-99be61af0e55 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:54.471951 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-336e1208-3ff3-424c-9ec1-99be61af0e55 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:38:54.481436 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-336e1208-3ff3-424c-9ec1-99be61af0e55 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f" status: 200 len: 1556 microversion: 2.1 time: 0.204131 Jun 23 22:38:54.483046 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 201/377] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:38:54 2022] GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f => generated 1556 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:54.504285 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d8641b8f-a8d1-41fa-8973-767f56a1657e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:54.506025 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-d8641b8f-a8d1-41fa-8973-767f56a1657e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: 384878db-4705-4f7b-87ff-0f079208412f] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:38:54.517241 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d8641b8f-a8d1-41fa-8973-767f56a1657e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:54.518752 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d8641b8f-a8d1-41fa-8973-767f56a1657e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:54.520013 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d8641b8f-a8d1-41fa-8973-767f56a1657e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:54.520722 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d8641b8f-a8d1-41fa-8973-767f56a1657e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:54.638120 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d8641b8f-a8d1-41fa-8973-767f56a1657e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.142817 Jun 23 22:38:54.639251 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 177/378] 10.222.0.43 () {58 vars in 1274 bytes} [Thu Jun 23 22:38:54 2022] GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f/os-interface => generated 284 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:38:55.176363 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [req-b2935e24-fb86-48e0-8fde-f25dcf9e9991 req-2966bd8a-5a1b-497b-ab8f-3c6c9ce6c885 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b", "tag": "e4f7fec0-2950-4a5c-8ce9-2b7668c8ae34"}]} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:38:55.185457 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-b2935e24-fb86-48e0-8fde-f25dcf9e9991 req-2966bd8a-5a1b-497b-ab8f-3c6c9ce6c885 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:55.185905 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-b2935e24-fb86-48e0-8fde-f25dcf9e9991 req-2966bd8a-5a1b-497b-ab8f-3c6c9ce6c885 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:55.199241 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.compute.server_external_events [req-b2935e24-fb86-48e0-8fde-f25dcf9e9991 req-2966bd8a-5a1b-497b-ab8f-3c6c9ce6c885 service nova] Creating event network-changed:e4f7fec0-2950-4a5c-8ce9-2b7668c8ae34 for instance 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b on hv-cinder-84617 Jun 23 22:38:55.205084 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [req-b2935e24-fb86-48e0-8fde-f25dcf9e9991 req-2966bd8a-5a1b-497b-ab8f-3c6c9ce6c885 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032872 Jun 23 22:38:55.205993 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 202/379] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:38:56.245599 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-50e0bea6-389b-47ee-a91b-a834d53ce1ab req-b508afa7-df39-4006-a5dc-122a3afa3035 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "384878db-4705-4f7b-87ff-0f079208412f", "tag": "f64c1270-e6bb-4c22-97a6-eb4fedf23371"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:38:56.264527 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-50e0bea6-389b-47ee-a91b-a834d53ce1ab req-b508afa7-df39-4006-a5dc-122a3afa3035 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:38:56.266040 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-50e0bea6-389b-47ee-a91b-a834d53ce1ab req-b508afa7-df39-4006-a5dc-122a3afa3035 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:38:56.292326 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-50e0bea6-389b-47ee-a91b-a834d53ce1ab req-b508afa7-df39-4006-a5dc-122a3afa3035 service nova] Creating event network-changed:f64c1270-e6bb-4c22-97a6-eb4fedf23371 for instance 384878db-4705-4f7b-87ff-0f079208412f on hv-cinder-84617 Jun 23 22:38:56.306094 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-50e0bea6-389b-47ee-a91b-a834d53ce1ab req-b508afa7-df39-4006-a5dc-122a3afa3035 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064194 Jun 23 22:38:56.306741 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 178/380] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:39:08.419983 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_api:SELECT=13 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:39:08.420708 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell1:SELECT=69 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:39:08.425508 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-5d539281-b4f6-47e2-9f29-b05454072e74 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-373710859", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-932418013", "security_groups": [{"name": "tempest-secgroup-smoke-2066458815"}], "block_device_mapping_v2": [{"uuid": "2e8224e3-36d7-48fe-9f6a-9220a56ff584", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0799b4b1-d9c3-4fcf-beb9-9324c17ca4f1"}]}} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:39:08.541411 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.network.neutron [None req-5d539281-b4f6-47e2-9f29-b05454072e74 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] validate_networks() for [('0799b4b1-d9c3-4fcf-beb9-9324c17ca4f1', None, None, None, None, None)] {{(pid=124357) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:39:08.919965 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-5d539281-b4f6-47e2-9f29-b05454072e74 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Flavor limits 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:39:08.920396 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-5d539281-b4f6-47e2-9f29-b05454072e74 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Image limits 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:39:08.920892 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-5d539281-b4f6-47e2-9f29-b05454072e74 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Flavor pref 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:39:08.921298 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-5d539281-b4f6-47e2-9f29-b05454072e74 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Image pref 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:39:08.921745 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-5d539281-b4f6-47e2-9f29-b05454072e74 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:39:08.931775 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5d539281-b4f6-47e2-9f29-b05454072e74 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:08.932280 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5d539281-b4f6-47e2-9f29-b05454072e74 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:08.933081 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5d539281-b4f6-47e2-9f29-b05454072e74 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:08.934248 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5d539281-b4f6-47e2-9f29-b05454072e74 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:08.952866 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-5d539281-b4f6-47e2-9f29-b05454072e74 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Getting quotas for project 1eb4b659032e4ec09a16c45b29d609f0. Resources: {'instances', 'cores', 'ram'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:39:08.956840 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-5d539281-b4f6-47e2-9f29-b05454072e74 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Getting quotas for user f523b529906f4fa989d0e836d6a08944 and project 1eb4b659032e4ec09a16c45b29d609f0. Resources: {'instances', 'cores', 'ram'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:39:09.018031 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-5d539281-b4f6-47e2-9f29-b05454072e74 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Going to run 1 instances... {{(pid=124357) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:39:09.020566 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-5d539281-b4f6-47e2-9f29-b05454072e74 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: b1da69bd-51f5-4223-b7aa-652d2636f36b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2e8224e3-36d7-48fe-9f6a-9220a56ff584',volume_size=None,volume_type=None)] {{(pid=124357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:39:09.154079 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-5d539281-b4f6-47e2-9f29-b05454072e74 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.735130 Jun 23 22:39:09.154757 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 203/381] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Jun 23 22:39:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 22:39:09.165867 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-6706a95f-705d-4747-9e67-21c6e7a567a2 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:09.166539 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-6706a95f-705d-4747-9e67-21c6e7a567a2 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: b1da69bd-51f5-4223-b7aa-652d2636f36b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:09.169275 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=21 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:39:09.170301 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=30 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:39:09.228714 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-6706a95f-705d-4747-9e67-21c6e7a567a2 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:09.237709 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-6706a95f-705d-4747-9e67-21c6e7a567a2 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b" status: 200 len: 1093 microversion: 2.1 time: 0.076518 Jun 23 22:39:09.238306 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 179/382] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:09 2022] GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b => generated 1093 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:10.255499 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-00a5a812-ebc3-4605-bd43-438227ae9f98 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:10.256091 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-00a5a812-ebc3-4605-bd43-438227ae9f98 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: b1da69bd-51f5-4223-b7aa-652d2636f36b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:10.263168 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-00a5a812-ebc3-4605-bd43-438227ae9f98 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:10.263620 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-00a5a812-ebc3-4605-bd43-438227ae9f98 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:10.264379 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-00a5a812-ebc3-4605-bd43-438227ae9f98 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:10.264809 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-00a5a812-ebc3-4605-bd43-438227ae9f98 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:10.325485 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-00a5a812-ebc3-4605-bd43-438227ae9f98 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:10.332882 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-00a5a812-ebc3-4605-bd43-438227ae9f98 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b" status: 200 len: 1191 microversion: 2.1 time: 0.081329 Jun 23 22:39:10.333439 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 204/383] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:10 2022] GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b => generated 1191 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:11.350211 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-486e2643-091b-4ac6-bea3-78336851a085 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:11.351097 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-486e2643-091b-4ac6-bea3-78336851a085 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: b1da69bd-51f5-4223-b7aa-652d2636f36b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:11.358371 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-486e2643-091b-4ac6-bea3-78336851a085 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:11.358825 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-486e2643-091b-4ac6-bea3-78336851a085 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:11.362065 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-486e2643-091b-4ac6-bea3-78336851a085 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:11.362508 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-486e2643-091b-4ac6-bea3-78336851a085 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:11.573570 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-486e2643-091b-4ac6-bea3-78336851a085 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:11.587211 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-486e2643-091b-4ac6-bea3-78336851a085 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b" status: 200 len: 1277 microversion: 2.1 time: 0.240089 Jun 23 22:39:11.598763 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 180/384] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:11 2022] GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b => generated 1277 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:12.182757 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [req-ebb7e413-6e7e-4a2c-9a24-1cda8c5418a0 req-4b9ae360-21ee-46fa-a2f9-e75d1a240a53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1da69bd-51f5-4223-b7aa-652d2636f36b", "tag": "9d8e2a40-5fc3-49a9-bca3-734e662a68dc"}]} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:39:12.198452 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-ebb7e413-6e7e-4a2c-9a24-1cda8c5418a0 req-4b9ae360-21ee-46fa-a2f9-e75d1a240a53 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:12.198985 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-ebb7e413-6e7e-4a2c-9a24-1cda8c5418a0 req-4b9ae360-21ee-46fa-a2f9-e75d1a240a53 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:12.210870 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.compute.server_external_events [req-ebb7e413-6e7e-4a2c-9a24-1cda8c5418a0 req-4b9ae360-21ee-46fa-a2f9-e75d1a240a53 service nova] Creating event network-changed:9d8e2a40-5fc3-49a9-bca3-734e662a68dc for instance b1da69bd-51f5-4223-b7aa-652d2636f36b on hv-cinder-84617 Jun 23 22:39:12.216395 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [req-ebb7e413-6e7e-4a2c-9a24-1cda8c5418a0 req-4b9ae360-21ee-46fa-a2f9-e75d1a240a53 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037221 Jun 23 22:39:12.216997 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 205/385] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:39:12.606774 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e5b11301-4cd9-4491-be26-8df893a8a75e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:12.607431 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e5b11301-4cd9-4491-be26-8df893a8a75e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: b1da69bd-51f5-4223-b7aa-652d2636f36b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:12.613864 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e5b11301-4cd9-4491-be26-8df893a8a75e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:12.614302 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e5b11301-4cd9-4491-be26-8df893a8a75e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:12.615912 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e5b11301-4cd9-4491-be26-8df893a8a75e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:12.616347 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e5b11301-4cd9-4491-be26-8df893a8a75e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:13.039161 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e5b11301-4cd9-4491-be26-8df893a8a75e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:13.047270 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e5b11301-4cd9-4491-be26-8df893a8a75e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b" status: 200 len: 1265 microversion: 2.1 time: 0.445457 Jun 23 22:39:13.056845 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 181/386] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:12 2022] GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b => generated 1265 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:14.064794 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-1de533ab-548a-4e41-b3ed-459e471fc0a6 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:14.065499 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-1de533ab-548a-4e41-b3ed-459e471fc0a6 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: b1da69bd-51f5-4223-b7aa-652d2636f36b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:14.071655 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1de533ab-548a-4e41-b3ed-459e471fc0a6 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:14.072105 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1de533ab-548a-4e41-b3ed-459e471fc0a6 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:14.072870 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1de533ab-548a-4e41-b3ed-459e471fc0a6 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:14.073304 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1de533ab-548a-4e41-b3ed-459e471fc0a6 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:14.216432 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-1de533ab-548a-4e41-b3ed-459e471fc0a6 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:14.227552 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-1de533ab-548a-4e41-b3ed-459e471fc0a6 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b" status: 200 len: 1265 microversion: 2.1 time: 0.167084 Jun 23 22:39:14.228123 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 206/387] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:14 2022] GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:15.245111 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-77de25bd-3295-4cb8-8daa-0d232ddfa68a tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:15.246400 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-77de25bd-3295-4cb8-8daa-0d232ddfa68a tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: b1da69bd-51f5-4223-b7aa-652d2636f36b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:15.253629 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-77de25bd-3295-4cb8-8daa-0d232ddfa68a tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:15.254150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-77de25bd-3295-4cb8-8daa-0d232ddfa68a tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:15.255216 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-77de25bd-3295-4cb8-8daa-0d232ddfa68a tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:15.255707 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-77de25bd-3295-4cb8-8daa-0d232ddfa68a tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:15.489165 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-77de25bd-3295-4cb8-8daa-0d232ddfa68a tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:15.497107 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-77de25bd-3295-4cb8-8daa-0d232ddfa68a tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b" status: 200 len: 1265 microversion: 2.1 time: 0.256259 Jun 23 22:39:15.497774 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 182/388] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:15 2022] GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:16.515592 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-c742a731-f3bf-4d57-8fa8-7a6c18f8a2c7 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:16.516407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-c742a731-f3bf-4d57-8fa8-7a6c18f8a2c7 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: b1da69bd-51f5-4223-b7aa-652d2636f36b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:16.523355 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c742a731-f3bf-4d57-8fa8-7a6c18f8a2c7 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:16.523903 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c742a731-f3bf-4d57-8fa8-7a6c18f8a2c7 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:16.524867 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c742a731-f3bf-4d57-8fa8-7a6c18f8a2c7 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:16.525357 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c742a731-f3bf-4d57-8fa8-7a6c18f8a2c7 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:16.775515 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-c742a731-f3bf-4d57-8fa8-7a6c18f8a2c7 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:16.784920 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-c742a731-f3bf-4d57-8fa8-7a6c18f8a2c7 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b" status: 200 len: 1265 microversion: 2.1 time: 0.274871 Jun 23 22:39:16.786329 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 207/389] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:16 2022] GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b => generated 1265 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:17.802237 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-5bbd5ff6-afe3-4399-a9f3-714a5cb08995 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:17.803689 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-5bbd5ff6-afe3-4399-a9f3-714a5cb08995 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: b1da69bd-51f5-4223-b7aa-652d2636f36b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:17.812316 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5bbd5ff6-afe3-4399-a9f3-714a5cb08995 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:17.813135 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5bbd5ff6-afe3-4399-a9f3-714a5cb08995 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:17.814135 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5bbd5ff6-afe3-4399-a9f3-714a5cb08995 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:17.814776 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5bbd5ff6-afe3-4399-a9f3-714a5cb08995 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:18.294556 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-5bbd5ff6-afe3-4399-a9f3-714a5cb08995 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:18.302323 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-5bbd5ff6-afe3-4399-a9f3-714a5cb08995 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b" status: 200 len: 1265 microversion: 2.1 time: 0.504414 Jun 23 22:39:18.302910 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 183/390] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:17 2022] GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b => generated 1265 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:19.320757 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-1d8934fb-bba8-4b1c-b706-2cd235f1d2f4 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:19.321380 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-1d8934fb-bba8-4b1c-b706-2cd235f1d2f4 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: b1da69bd-51f5-4223-b7aa-652d2636f36b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:19.323769 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell0:SELECT=2 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:39:19.324848 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell0:SELECT=6 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:39:19.333857 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1d8934fb-bba8-4b1c-b706-2cd235f1d2f4 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:19.334308 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1d8934fb-bba8-4b1c-b706-2cd235f1d2f4 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:19.335128 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1d8934fb-bba8-4b1c-b706-2cd235f1d2f4 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:19.335565 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1d8934fb-bba8-4b1c-b706-2cd235f1d2f4 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:19.494662 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-1d8934fb-bba8-4b1c-b706-2cd235f1d2f4 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:19.503674 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-1d8934fb-bba8-4b1c-b706-2cd235f1d2f4 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b" status: 200 len: 1265 microversion: 2.1 time: 0.186705 Jun 23 22:39:19.512409 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 208/391] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:19 2022] GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:20.520091 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-ad2df32d-7d74-45e0-b691-6a65d747f954 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:20.520689 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-ad2df32d-7d74-45e0-b691-6a65d747f954 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: b1da69bd-51f5-4223-b7aa-652d2636f36b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:20.526354 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=2 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:39:20.531616 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ad2df32d-7d74-45e0-b691-6a65d747f954 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:20.532499 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ad2df32d-7d74-45e0-b691-6a65d747f954 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:20.534373 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ad2df32d-7d74-45e0-b691-6a65d747f954 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:20.535181 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ad2df32d-7d74-45e0-b691-6a65d747f954 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:20.922503 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ad2df32d-7d74-45e0-b691-6a65d747f954 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:20.933080 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-ad2df32d-7d74-45e0-b691-6a65d747f954 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b" status: 200 len: 1265 microversion: 2.1 time: 0.416666 Jun 23 22:39:20.944463 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 184/392] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:20 2022] GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b => generated 1265 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:21.952075 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-281df620-01de-4513-8feb-c115c5e40b72 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:21.958988 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-281df620-01de-4513-8feb-c115c5e40b72 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: b1da69bd-51f5-4223-b7aa-652d2636f36b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:21.978347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-281df620-01de-4513-8feb-c115c5e40b72 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:21.984004 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-281df620-01de-4513-8feb-c115c5e40b72 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:21.986873 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-281df620-01de-4513-8feb-c115c5e40b72 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:21.987578 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-281df620-01de-4513-8feb-c115c5e40b72 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:22.332313 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-281df620-01de-4513-8feb-c115c5e40b72 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:22.340426 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-281df620-01de-4513-8feb-c115c5e40b72 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b" status: 200 len: 1265 microversion: 2.1 time: 0.393002 Jun 23 22:39:22.341364 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 209/393] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:21 2022] GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b => generated 1265 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:23.358205 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-6be219e5-50f8-4a02-96c8-fd6c98a8f170 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:23.358827 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-6be219e5-50f8-4a02-96c8-fd6c98a8f170 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: b1da69bd-51f5-4223-b7aa-652d2636f36b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:23.378585 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6be219e5-50f8-4a02-96c8-fd6c98a8f170 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:23.379059 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6be219e5-50f8-4a02-96c8-fd6c98a8f170 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:23.380231 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6be219e5-50f8-4a02-96c8-fd6c98a8f170 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:23.380825 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6be219e5-50f8-4a02-96c8-fd6c98a8f170 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:23.682368 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-6be219e5-50f8-4a02-96c8-fd6c98a8f170 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:23.692039 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-6be219e5-50f8-4a02-96c8-fd6c98a8f170 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b" status: 200 len: 1265 microversion: 2.1 time: 0.338111 Jun 23 22:39:23.692524 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 185/394] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:23 2022] GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b => generated 1265 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:24.068734 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-84133332-bc71-43c1-bf1c-390fc4a4a123 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Action: 'create', calling method: .version_select at 0x7fb719923d30>, body: {"keypair": {"name": "tempest-TestShelveInstance-162414453", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0d4UoENkJPBl1sRDBsgOOL5SlNNfln78eCuHO5/mqmwenO7lq3tFYHKBKj8JGxv4RCLkBVS1hiRg/rebU6w5wWnqY1LlpBVZJci2D1U0oMTOhZovo5vWhkefBj7bGY9Q=="}} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:39:24.084208 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-84133332-bc71-43c1-bf1c-390fc4a4a123 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Getting quotas for project dceb245422db46eaa1440c39b5755aca. Resources: {'key_pairs'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:39:24.088422 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-84133332-bc71-43c1-bf1c-390fc4a4a123 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Getting quotas for user 35838f82371148dda993ca515a1be79c and project dceb245422db46eaa1440c39b5755aca. Resources: {'key_pairs'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:39:24.111258 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-84133332-bc71-43c1-bf1c-390fc4a4a123 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.250735 Jun 23 22:39:24.111971 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 210/395] 10.222.0.43 () {60 vars in 1158 bytes} [Thu Jun 23 22:39:23 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:39:24.709740 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c48b30c9-8c93-4c4b-a3bf-093759b3c164 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:24.710265 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c48b30c9-8c93-4c4b-a3bf-093759b3c164 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: b1da69bd-51f5-4223-b7aa-652d2636f36b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:24.718799 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c48b30c9-8c93-4c4b-a3bf-093759b3c164 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:24.719463 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c48b30c9-8c93-4c4b-a3bf-093759b3c164 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:24.720374 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c48b30c9-8c93-4c4b-a3bf-093759b3c164 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:24.720800 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c48b30c9-8c93-4c4b-a3bf-093759b3c164 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:24.884454 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c48b30c9-8c93-4c4b-a3bf-093759b3c164 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:24.895663 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c48b30c9-8c93-4c4b-a3bf-093759b3c164 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b" status: 200 len: 1265 microversion: 2.1 time: 0.189782 Jun 23 22:39:24.906761 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 186/396] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:24 2022] GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:25.187149 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [req-bf62bdbe-3d8e-4c05-bb6d-b6e469a00c8c req-156ccfde-0142-4dd8-9d4e-34caf0ac519e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1da69bd-51f5-4223-b7aa-652d2636f36b", "name": "network-vif-plugged", "status": "completed", "tag": "9d8e2a40-5fc3-49a9-bca3-734e662a68dc"}]} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:39:25.207558 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-bf62bdbe-3d8e-4c05-bb6d-b6e469a00c8c req-156ccfde-0142-4dd8-9d4e-34caf0ac519e service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:25.208436 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-bf62bdbe-3d8e-4c05-bb6d-b6e469a00c8c req-156ccfde-0142-4dd8-9d4e-34caf0ac519e service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:25.223823 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.compute.server_external_events [req-bf62bdbe-3d8e-4c05-bb6d-b6e469a00c8c req-156ccfde-0142-4dd8-9d4e-34caf0ac519e service nova] Creating event network-vif-plugged:9d8e2a40-5fc3-49a9-bca3-734e662a68dc for instance b1da69bd-51f5-4223-b7aa-652d2636f36b on hv-cinder-84617 Jun 23 22:39:25.230119 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [req-bf62bdbe-3d8e-4c05-bb6d-b6e469a00c8c req-156ccfde-0142-4dd8-9d4e-34caf0ac519e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047276 Jun 23 22:39:25.231694 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 211/397] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:39:25.912982 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b83a5f35-409e-416d-9efa-8167773fd3f5 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:25.913625 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-b83a5f35-409e-416d-9efa-8167773fd3f5 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: b1da69bd-51f5-4223-b7aa-652d2636f36b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:25.920235 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b83a5f35-409e-416d-9efa-8167773fd3f5 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:25.920683 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b83a5f35-409e-416d-9efa-8167773fd3f5 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:25.921448 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b83a5f35-409e-416d-9efa-8167773fd3f5 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:25.921877 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b83a5f35-409e-416d-9efa-8167773fd3f5 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:26.061090 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b83a5f35-409e-416d-9efa-8167773fd3f5 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:26.068519 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-b83a5f35-409e-416d-9efa-8167773fd3f5 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b" status: 200 len: 1265 microversion: 2.1 time: 0.159639 Jun 23 22:39:26.069078 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 187/398] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:25 2022] GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:27.087753 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-b46b95e5-5423-4a1b-a405-22bdea89e865 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:27.088451 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-b46b95e5-5423-4a1b-a405-22bdea89e865 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: b1da69bd-51f5-4223-b7aa-652d2636f36b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:27.096630 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-b46b95e5-5423-4a1b-a405-22bdea89e865 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:27.097191 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-b46b95e5-5423-4a1b-a405-22bdea89e865 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:27.098327 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-b46b95e5-5423-4a1b-a405-22bdea89e865 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:27.098766 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-b46b95e5-5423-4a1b-a405-22bdea89e865 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:27.241647 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-b46b95e5-5423-4a1b-a405-22bdea89e865 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:27.256649 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-b46b95e5-5423-4a1b-a405-22bdea89e865 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b" status: 200 len: 1452 microversion: 2.1 time: 0.173888 Jun 23 22:39:27.264169 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 212/399] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:27 2022] GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b => generated 1452 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:27.276974 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-05c12240-c0cc-4c33-9739-5e9ad1495e7c tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:27.278958 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-05c12240-c0cc-4c33-9739-5e9ad1495e7c tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: b1da69bd-51f5-4223-b7aa-652d2636f36b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:27.285726 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-05c12240-c0cc-4c33-9739-5e9ad1495e7c tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:27.286582 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-05c12240-c0cc-4c33-9739-5e9ad1495e7c tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:27.287466 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-05c12240-c0cc-4c33-9739-5e9ad1495e7c tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:27.287953 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-05c12240-c0cc-4c33-9739-5e9ad1495e7c tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:27.432533 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-05c12240-c0cc-4c33-9739-5e9ad1495e7c tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:27.443319 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-05c12240-c0cc-4c33-9739-5e9ad1495e7c tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b" status: 200 len: 1452 microversion: 2.1 time: 0.171066 Jun 23 22:39:27.454470 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 188/400] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:27 2022] GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b => generated 1452 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:39:29.405236 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [req-4d9ca080-381c-4d11-904f-dd79c397f527 req-f9036375-a228-4f54-95dd-87c33802a9d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1da69bd-51f5-4223-b7aa-652d2636f36b", "tag": "9d8e2a40-5fc3-49a9-bca3-734e662a68dc"}]} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:39:29.413634 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-4d9ca080-381c-4d11-904f-dd79c397f527 req-f9036375-a228-4f54-95dd-87c33802a9d6 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:29.414079 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-4d9ca080-381c-4d11-904f-dd79c397f527 req-f9036375-a228-4f54-95dd-87c33802a9d6 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:29.426342 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.compute.server_external_events [req-4d9ca080-381c-4d11-904f-dd79c397f527 req-f9036375-a228-4f54-95dd-87c33802a9d6 service nova] Creating event network-changed:9d8e2a40-5fc3-49a9-bca3-734e662a68dc for instance b1da69bd-51f5-4223-b7aa-652d2636f36b on hv-cinder-84617 Jun 23 22:39:29.431725 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [req-4d9ca080-381c-4d11-904f-dd79c397f527 req-f9036375-a228-4f54-95dd-87c33802a9d6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031253 Jun 23 22:39:29.432665 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 213/401] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:39:37.425565 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-eaced896-e43b-4a25-b067-4f26b975a74e tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:37.426081 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-eaced896-e43b-4a25-b067-4f26b975a74e tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:37.428622 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=22 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:39:37.433946 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-eaced896-e43b-4a25-b067-4f26b975a74e tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:37.434379 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-eaced896-e43b-4a25-b067-4f26b975a74e tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:37.435224 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-eaced896-e43b-4a25-b067-4f26b975a74e tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:37.435695 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-eaced896-e43b-4a25-b067-4f26b975a74e tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:37.466879 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=54 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:39:37.568648 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.objects.instance [None req-eaced896-e43b-4a25-b067-4f26b975a74e tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lazy-loading 'services' on Instance uuid f910ba21-0126-4f09-8fd9-10f2365e67c1 {{(pid=124358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:39:37.681987 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-eaced896-e43b-4a25-b067-4f26b975a74e tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1/os-volume_attachments/e835c382-3f19-4ec9-a35f-992b8924b333" status: 202 len: 0 microversion: 2.1 time: 0.260524 Jun 23 22:39:37.682493 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 189/402] 10.222.0.43 () {58 vars in 1415 bytes} [Thu Jun 23 22:39:37 2022] DELETE /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1/os-volume_attachments/e835c382-3f19-4ec9-a35f-992b8924b333 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:39:39.849197 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell0:SELECT=4 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:39:39.850132 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=4 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:39:39.850755 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell1:SELECT=44 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:39:39.854962 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-59c99d47-c366-49d4-b407-2041c673bd35 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:39:39.863385 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-59c99d47-c366-49d4-b407-2041c673bd35 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:39.863858 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-59c99d47-c366-49d4-b407-2041c673bd35 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:39.885669 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-59c99d47-c366-49d4-b407-2041c673bd35 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Going to try to stop instance {{(pid=124357) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 23 22:39:39.927018 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-59c99d47-c366-49d4-b407-2041c673bd35 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "POST /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1/action" status: 202 len: 0 microversion: 2.1 time: 0.078271 Jun 23 22:39:39.927902 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 214/403] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Jun 23 22:39:39 2022] POST /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 22:39:39.937676 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a41a967e-be5a-42b1-9923-e4f9e6f7b7b0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:39.938653 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-a41a967e-be5a-42b1-9923-e4f9e6f7b7b0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:39.944775 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a41a967e-be5a-42b1-9923-e4f9e6f7b7b0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:39.945288 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a41a967e-be5a-42b1-9923-e4f9e6f7b7b0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:39.946100 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a41a967e-be5a-42b1-9923-e4f9e6f7b7b0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:39.946595 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a41a967e-be5a-42b1-9923-e4f9e6f7b7b0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:40.080933 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-a41a967e-be5a-42b1-9923-e4f9e6f7b7b0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:40.088423 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-a41a967e-be5a-42b1-9923-e4f9e6f7b7b0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1675 microversion: 2.1 time: 0.155507 Jun 23 22:39:40.088982 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 190/404] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:39 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:39:41.106228 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-b638da9f-9fec-4663-a2f9-80a65e0a7ff3 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:41.106949 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-b638da9f-9fec-4663-a2f9-80a65e0a7ff3 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:41.114354 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-b638da9f-9fec-4663-a2f9-80a65e0a7ff3 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:41.114797 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-b638da9f-9fec-4663-a2f9-80a65e0a7ff3 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:41.115584 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-b638da9f-9fec-4663-a2f9-80a65e0a7ff3 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:41.116016 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-b638da9f-9fec-4663-a2f9-80a65e0a7ff3 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:41.256118 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-b638da9f-9fec-4663-a2f9-80a65e0a7ff3 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:41.263692 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-b638da9f-9fec-4663-a2f9-80a65e0a7ff3 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1675 microversion: 2.1 time: 0.161678 Jun 23 22:39:41.264332 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 215/405] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:41 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:42.281455 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-fa90f804-5127-43f8-b22a-2c20b03a3c09 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:42.282061 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-fa90f804-5127-43f8-b22a-2c20b03a3c09 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:42.288844 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fa90f804-5127-43f8-b22a-2c20b03a3c09 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:42.289277 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fa90f804-5127-43f8-b22a-2c20b03a3c09 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:42.290017 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fa90f804-5127-43f8-b22a-2c20b03a3c09 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:42.290439 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fa90f804-5127-43f8-b22a-2c20b03a3c09 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:42.419565 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-fa90f804-5127-43f8-b22a-2c20b03a3c09 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:42.427650 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-fa90f804-5127-43f8-b22a-2c20b03a3c09 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1675 microversion: 2.1 time: 0.149996 Jun 23 22:39:42.428247 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 191/406] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:42 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:43.444614 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-99ce82a6-bc10-48fc-a996-dd3fc5440fe5 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:43.445148 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-99ce82a6-bc10-48fc-a996-dd3fc5440fe5 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:43.451317 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-99ce82a6-bc10-48fc-a996-dd3fc5440fe5 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:43.451762 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-99ce82a6-bc10-48fc-a996-dd3fc5440fe5 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:43.452509 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-99ce82a6-bc10-48fc-a996-dd3fc5440fe5 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:43.453049 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-99ce82a6-bc10-48fc-a996-dd3fc5440fe5 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:43.583579 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-99ce82a6-bc10-48fc-a996-dd3fc5440fe5 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:43.591035 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-99ce82a6-bc10-48fc-a996-dd3fc5440fe5 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1675 microversion: 2.1 time: 0.150273 Jun 23 22:39:43.591603 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 216/407] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:43 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:43.684593 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-188c2688-773d-452f-b039-419eebc81534 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-611110316", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-162414453", "security_groups": [{"name": "tempest-secgroup-smoke-1398895566"}], "networks": [{"uuid": "1bfbead6-2fd3-44e6-aaa5-ecacb98f0fbc"}], "block_device_mapping_v2": [{"uuid": "606c7e53-a697-4a56-b78e-1bf532e6e50e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:39:43.792809 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.network.neutron [None req-188c2688-773d-452f-b039-419eebc81534 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] validate_networks() for [('1bfbead6-2fd3-44e6-aaa5-ecacb98f0fbc', None, None, None, None, None)] {{(pid=124358) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:39:44.145230 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-188c2688-773d-452f-b039-419eebc81534 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Flavor limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:39:44.145641 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-188c2688-773d-452f-b039-419eebc81534 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Image limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:39:44.146102 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-188c2688-773d-452f-b039-419eebc81534 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Flavor pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:39:44.146504 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-188c2688-773d-452f-b039-419eebc81534 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Image pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:39:44.146902 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-188c2688-773d-452f-b039-419eebc81534 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:39:44.155695 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-188c2688-773d-452f-b039-419eebc81534 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:44.156128 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-188c2688-773d-452f-b039-419eebc81534 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:44.157474 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-188c2688-773d-452f-b039-419eebc81534 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:44.157895 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-188c2688-773d-452f-b039-419eebc81534 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:44.174753 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-188c2688-773d-452f-b039-419eebc81534 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Getting quotas for project dceb245422db46eaa1440c39b5755aca. Resources: {'instances', 'cores', 'ram'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:39:44.178670 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-188c2688-773d-452f-b039-419eebc81534 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Getting quotas for user 35838f82371148dda993ca515a1be79c and project dceb245422db46eaa1440c39b5755aca. Resources: {'instances', 'cores', 'ram'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:39:44.234622 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-188c2688-773d-452f-b039-419eebc81534 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Going to run 1 instances... {{(pid=124358) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:39:44.236954 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-188c2688-773d-452f-b039-419eebc81534 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='606c7e53-a697-4a56-b78e-1bf532e6e50e',volume_size=None,volume_type=None)] {{(pid=124358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:39:44.360841 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-188c2688-773d-452f-b039-419eebc81534 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.679959 Jun 23 22:39:44.361486 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 192/408] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Jun 23 22:39:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 22:39:44.371360 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-8ce6d157-aedd-4a97-a0b7-fe9b2ece8cd3 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:44.372061 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-8ce6d157-aedd-4a97-a0b7-fe9b2ece8cd3 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:44.433255 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-8ce6d157-aedd-4a97-a0b7-fe9b2ece8cd3 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:44.440231 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-8ce6d157-aedd-4a97-a0b7-fe9b2ece8cd3 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1087 microversion: 2.1 time: 0.072754 Jun 23 22:39:44.440804 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 217/409] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:44 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1087 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:44.607682 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a265865e-e441-4327-9946-1815c78e473a tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:44.608285 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-a265865e-e441-4327-9946-1815c78e473a tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:44.614752 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a265865e-e441-4327-9946-1815c78e473a tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:44.615265 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a265865e-e441-4327-9946-1815c78e473a tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:44.616027 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a265865e-e441-4327-9946-1815c78e473a tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:44.616462 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a265865e-e441-4327-9946-1815c78e473a tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:44.759040 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-a265865e-e441-4327-9946-1815c78e473a tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:44.770232 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-a265865e-e441-4327-9946-1815c78e473a tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1675 microversion: 2.1 time: 0.166432 Jun 23 22:39:44.770799 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 193/410] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:44 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:45.457630 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-9ecafbd0-98d5-4a7b-9e4f-379ef5bf1266 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:45.458182 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-9ecafbd0-98d5-4a7b-9e4f-379ef5bf1266 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:45.464605 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9ecafbd0-98d5-4a7b-9e4f-379ef5bf1266 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:45.465044 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9ecafbd0-98d5-4a7b-9e4f-379ef5bf1266 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:45.465923 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9ecafbd0-98d5-4a7b-9e4f-379ef5bf1266 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:45.466342 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9ecafbd0-98d5-4a7b-9e4f-379ef5bf1266 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:45.556399 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-9ecafbd0-98d5-4a7b-9e4f-379ef5bf1266 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:45.565026 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-9ecafbd0-98d5-4a7b-9e4f-379ef5bf1266 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1193 microversion: 2.1 time: 0.111494 Jun 23 22:39:45.566101 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 218/411] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:45 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1193 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:45.788568 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-ae7be68c-bbf1-45e0-97b5-ecf001ee9f00 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:45.789187 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-ae7be68c-bbf1-45e0-97b5-ecf001ee9f00 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:45.796126 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ae7be68c-bbf1-45e0-97b5-ecf001ee9f00 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:45.796573 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ae7be68c-bbf1-45e0-97b5-ecf001ee9f00 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:45.797374 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ae7be68c-bbf1-45e0-97b5-ecf001ee9f00 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:45.797889 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ae7be68c-bbf1-45e0-97b5-ecf001ee9f00 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:46.000875 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ae7be68c-bbf1-45e0-97b5-ecf001ee9f00 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:46.008549 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-ae7be68c-bbf1-45e0-97b5-ecf001ee9f00 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1675 microversion: 2.1 time: 0.224018 Jun 23 22:39:46.009131 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 194/412] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:45 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1675 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:46.582692 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-84a679cc-837c-4d99-99a4-6bd3009f656f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:46.583271 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-84a679cc-837c-4d99-99a4-6bd3009f656f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:46.589131 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-84a679cc-837c-4d99-99a4-6bd3009f656f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:46.589570 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-84a679cc-837c-4d99-99a4-6bd3009f656f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:46.590316 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-84a679cc-837c-4d99-99a4-6bd3009f656f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:46.590742 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-84a679cc-837c-4d99-99a4-6bd3009f656f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:46.797165 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-84a679cc-837c-4d99-99a4-6bd3009f656f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:46.806164 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-84a679cc-837c-4d99-99a4-6bd3009f656f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1259 microversion: 2.1 time: 0.227940 Jun 23 22:39:46.806745 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 219/413] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:46 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1259 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:46.996329 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-1a9dbfa0-9e04-4b84-b970-977340c1f4bf req-734bd580-6058-4638-8eb1-8d694ea80d77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "628515ea-c2f6-490f-a67d-13d0e97698ac", "tag": "0b2f39d0-0fe2-4db8-9e32-5112a69d2b21"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:39:47.007985 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-1a9dbfa0-9e04-4b84-b970-977340c1f4bf req-734bd580-6058-4638-8eb1-8d694ea80d77 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:47.008461 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-1a9dbfa0-9e04-4b84-b970-977340c1f4bf req-734bd580-6058-4638-8eb1-8d694ea80d77 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:47.021957 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-1a9dbfa0-9e04-4b84-b970-977340c1f4bf req-734bd580-6058-4638-8eb1-8d694ea80d77 service nova] Creating event network-changed:0b2f39d0-0fe2-4db8-9e32-5112a69d2b21 for instance 628515ea-c2f6-490f-a67d-13d0e97698ac on hv-cinder-84617 Jun 23 22:39:47.025893 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-40744bd8-b822-4b11-a51b-df28c21875a5 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:47.026584 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-40744bd8-b822-4b11-a51b-df28c21875a5 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:47.028905 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-1a9dbfa0-9e04-4b84-b970-977340c1f4bf req-734bd580-6058-4638-8eb1-8d694ea80d77 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036564 Jun 23 22:39:47.029506 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 195/414] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:39:47.033290 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-40744bd8-b822-4b11-a51b-df28c21875a5 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:47.033743 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-40744bd8-b822-4b11-a51b-df28c21875a5 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:47.034687 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-40744bd8-b822-4b11-a51b-df28c21875a5 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:47.035175 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-40744bd8-b822-4b11-a51b-df28c21875a5 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:47.255196 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-40744bd8-b822-4b11-a51b-df28c21875a5 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:47.262741 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-40744bd8-b822-4b11-a51b-df28c21875a5 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1675 microversion: 2.1 time: 0.241102 Jun 23 22:39:47.263346 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 220/415] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:47 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1675 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:39:47.824490 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-2f565629-242a-49b1-a34a-9e774493cbe1 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:47.825212 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-2f565629-242a-49b1-a34a-9e774493cbe1 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:47.832025 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2f565629-242a-49b1-a34a-9e774493cbe1 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:47.832489 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2f565629-242a-49b1-a34a-9e774493cbe1 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:47.833240 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2f565629-242a-49b1-a34a-9e774493cbe1 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:47.833667 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2f565629-242a-49b1-a34a-9e774493cbe1 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:48.279660 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-d4930e91-b00a-46f6-a229-10c277abd8f7 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:48.280269 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-d4930e91-b00a-46f6-a229-10c277abd8f7 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:48.287471 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d4930e91-b00a-46f6-a229-10c277abd8f7 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:48.287918 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d4930e91-b00a-46f6-a229-10c277abd8f7 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:48.288682 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d4930e91-b00a-46f6-a229-10c277abd8f7 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:48.289114 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d4930e91-b00a-46f6-a229-10c277abd8f7 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:48.289895 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-2f565629-242a-49b1-a34a-9e774493cbe1 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:48.298513 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-2f565629-242a-49b1-a34a-9e774493cbe1 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1259 microversion: 2.1 time: 0.478068 Jun 23 22:39:48.299200 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 196/416] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:47 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1259 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:48.458408 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-d4930e91-b00a-46f6-a229-10c277abd8f7 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:48.466153 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-d4930e91-b00a-46f6-a229-10c277abd8f7 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1675 microversion: 2.1 time: 0.190294 Jun 23 22:39:48.466720 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 221/417] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:48 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1675 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:39:49.315505 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-10c91789-79e6-4b56-aa78-bb6543bdc4a9 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:49.316049 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-10c91789-79e6-4b56-aa78-bb6543bdc4a9 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:49.322484 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-10c91789-79e6-4b56-aa78-bb6543bdc4a9 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:49.322945 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-10c91789-79e6-4b56-aa78-bb6543bdc4a9 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:49.323699 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-10c91789-79e6-4b56-aa78-bb6543bdc4a9 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:49.324127 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-10c91789-79e6-4b56-aa78-bb6543bdc4a9 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:49.458818 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-10c91789-79e6-4b56-aa78-bb6543bdc4a9 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:49.466384 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-10c91789-79e6-4b56-aa78-bb6543bdc4a9 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1259 microversion: 2.1 time: 0.155400 Jun 23 22:39:49.466963 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 197/418] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:49 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:49.483092 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-eff4658f-f750-4eff-b783-00b057160f12 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:49.483702 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-eff4658f-f750-4eff-b783-00b057160f12 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:49.490092 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-eff4658f-f750-4eff-b783-00b057160f12 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:49.490535 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-eff4658f-f750-4eff-b783-00b057160f12 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:49.491313 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-eff4658f-f750-4eff-b783-00b057160f12 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:49.491740 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-eff4658f-f750-4eff-b783-00b057160f12 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:49.620769 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-eff4658f-f750-4eff-b783-00b057160f12 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:49.628548 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-eff4658f-f750-4eff-b783-00b057160f12 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1675 microversion: 2.1 time: 0.149256 Jun 23 22:39:49.629103 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 222/419] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:49 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:50.483952 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f7047ada-0b99-4e9d-917b-2da88d6ece2f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:50.484559 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-f7047ada-0b99-4e9d-917b-2da88d6ece2f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:50.491171 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f7047ada-0b99-4e9d-917b-2da88d6ece2f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:50.491612 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f7047ada-0b99-4e9d-917b-2da88d6ece2f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:50.492371 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f7047ada-0b99-4e9d-917b-2da88d6ece2f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:50.492802 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f7047ada-0b99-4e9d-917b-2da88d6ece2f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:50.496215 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-25daa78c-9be0-4b4d-b6f3-5aa2afbf30b6 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9659d8f6-7895-409e-a775-6d2be766f904"}} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:39:50.497325 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-25daa78c-9be0-4b4d-b6f3-5aa2afbf30b6 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:50.503275 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-25daa78c-9be0-4b4d-b6f3-5aa2afbf30b6 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:50.503715 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-25daa78c-9be0-4b4d-b6f3-5aa2afbf30b6 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:50.504464 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-25daa78c-9be0-4b4d-b6f3-5aa2afbf30b6 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:50.504889 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-25daa78c-9be0-4b4d-b6f3-5aa2afbf30b6 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:50.626043 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f7047ada-0b99-4e9d-917b-2da88d6ece2f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:50.635381 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f7047ada-0b99-4e9d-917b-2da88d6ece2f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1259 microversion: 2.1 time: 0.155142 Jun 23 22:39:50.635963 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 198/420] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:50 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:39:50.645930 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-00c8e2a9-f166-486a-9cb2-61fa2a697519 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:50.646577 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-00c8e2a9-f166-486a-9cb2-61fa2a697519 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:50.652648 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-00c8e2a9-f166-486a-9cb2-61fa2a697519 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:50.653084 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-00c8e2a9-f166-486a-9cb2-61fa2a697519 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:50.653838 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-00c8e2a9-f166-486a-9cb2-61fa2a697519 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:50.654256 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-00c8e2a9-f166-486a-9cb2-61fa2a697519 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:50.771976 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-25daa78c-9be0-4b4d-b6f3-5aa2afbf30b6 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "POST /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279473 Jun 23 22:39:50.772598 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 223/421] 10.222.0.43 () {60 vars in 1322 bytes} [Thu Jun 23 22:39:50 2022] POST /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:39:50.801346 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-00c8e2a9-f166-486a-9cb2-61fa2a697519 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:50.809972 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-00c8e2a9-f166-486a-9cb2-61fa2a697519 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1652 microversion: 2.1 time: 0.168332 Jun 23 22:39:50.810766 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 199/422] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:50 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1652 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:39:50.827503 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-dacca866-4a03-4d3a-b514-c4f1ed2d7d15 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:39:50.835594 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-dacca866-4a03-4d3a-b514-c4f1ed2d7d15 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:50.836131 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-dacca866-4a03-4d3a-b514-c4f1ed2d7d15 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:50.860511 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-dacca866-4a03-4d3a-b514-c4f1ed2d7d15 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Going to try to start instance {{(pid=124357) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 23 22:39:50.903562 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-dacca866-4a03-4d3a-b514-c4f1ed2d7d15 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "POST /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1/action" status: 202 len: 0 microversion: 2.1 time: 0.080028 Jun 23 22:39:50.904531 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 224/423] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Jun 23 22:39:50 2022] POST /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:39:50.915286 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c5dc745d-37af-4bbd-b397-55be9a3c516d tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:50.915906 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c5dc745d-37af-4bbd-b397-55be9a3c516d tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:50.923620 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c5dc745d-37af-4bbd-b397-55be9a3c516d tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:50.924434 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c5dc745d-37af-4bbd-b397-55be9a3c516d tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:50.926903 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c5dc745d-37af-4bbd-b397-55be9a3c516d tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:50.927569 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c5dc745d-37af-4bbd-b397-55be9a3c516d tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:51.102013 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c5dc745d-37af-4bbd-b397-55be9a3c516d tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:51.109992 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c5dc745d-37af-4bbd-b397-55be9a3c516d tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1661 microversion: 2.1 time: 0.199643 Jun 23 22:39:51.110739 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 200/424] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:50 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1661 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:51.653112 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-44c1c489-3a73-4a8f-9e10-eeb73ed39485 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:51.653729 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-44c1c489-3a73-4a8f-9e10-eeb73ed39485 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:51.660440 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-44c1c489-3a73-4a8f-9e10-eeb73ed39485 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:51.660882 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-44c1c489-3a73-4a8f-9e10-eeb73ed39485 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:51.661890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-44c1c489-3a73-4a8f-9e10-eeb73ed39485 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:51.662323 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-44c1c489-3a73-4a8f-9e10-eeb73ed39485 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:51.798416 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-44c1c489-3a73-4a8f-9e10-eeb73ed39485 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:51.805927 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-44c1c489-3a73-4a8f-9e10-eeb73ed39485 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1259 microversion: 2.1 time: 0.157080 Jun 23 22:39:51.806488 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 225/425] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:51 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:51.824444 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-8f082cc0-25d2-4aae-ba8b-c2b2f2767a52 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:51.824954 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-8f082cc0-25d2-4aae-ba8b-c2b2f2767a52 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: 384878db-4705-4f7b-87ff-0f079208412f] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:51.831374 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8f082cc0-25d2-4aae-ba8b-c2b2f2767a52 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:51.831817 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8f082cc0-25d2-4aae-ba8b-c2b2f2767a52 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:51.832571 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8f082cc0-25d2-4aae-ba8b-c2b2f2767a52 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:51.833006 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8f082cc0-25d2-4aae-ba8b-c2b2f2767a52 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:51.855995 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-8f082cc0-25d2-4aae-ba8b-c2b2f2767a52 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f/ips" status: 200 len: 150 microversion: 2.1 time: 0.035311 Jun 23 22:39:51.856575 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 201/426] 10.222.0.43 () {58 vars in 1247 bytes} [Thu Jun 23 22:39:51 2022] GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:39:51.867582 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-6fba0c08-684b-49c5-8fb1-078b86d1221f tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00ed731e-c77b-464f-90cf-6ff5fdc8faca"}} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:39:51.868725 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-6fba0c08-684b-49c5-8fb1-078b86d1221f tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: 384878db-4705-4f7b-87ff-0f079208412f] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:51.874704 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6fba0c08-684b-49c5-8fb1-078b86d1221f tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:51.875286 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6fba0c08-684b-49c5-8fb1-078b86d1221f tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:51.876893 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6fba0c08-684b-49c5-8fb1-078b86d1221f tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:51.877350 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6fba0c08-684b-49c5-8fb1-078b86d1221f tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:51.956140 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.wsgi [None req-6fba0c08-684b-49c5-8fb1-078b86d1221f tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] HTTP exception thrown: Invalid volume: volume 00ed731e-c77b-464f-90cf-6ff5fdc8faca is already attached to instances: cd22650e-6851-4f81-a8d4-e4c7ade26c73 Jun 23 22:39:51.957878 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-6fba0c08-684b-49c5-8fb1-078b86d1221f tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Request method failure captured: Jun 23 22:39:51.957878 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: request: POST /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f/os-volume_attachments HTTP/1.1 Jun 23 22:39:51.957878 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept: application/json Jun 23 22:39:51.957878 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept-Encoding: identity Jun 23 22:39:51.957878 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Connection: close Jun 23 22:39:51.957878 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Length: 74 Jun 23 22:39:51.957878 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Type: application/json Jun 23 22:39:51.957878 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Host: 10.222.0.43 Jun 23 22:39:51.957878 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Openstack-System-Scope: None Jun 23 22:39:51.957878 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: User-Agent: python-urllib3/1.26.9 Jun 23 22:39:51.957878 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Auth-Token: gAAAAABitOrWyDITCi2PmBTdDblZ-ZSwK9B2UK_lIIWOMJB9Z-7YhxsoOI1DrhAeUCIChTCXv2hii5VV1HcTnkYXbW5bgXE95MCdJVwhuPtEsdt8Afqc-N7hZn6zZkza9EI9jSK71KcKdXUQCp4unsH4J6JfPLYATxcY6NVUnHVlcszTDCqSUi0 Jun 23 22:39:51.957878 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Id: None Jun 23 22:39:51.957878 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Name: None Jun 23 22:39:51.957878 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Identity-Status: Confirmed Jun 23 22:39:51.957878 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Is-Admin-Project: True Jun 23 22:39:51.957878 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Id: default Jun 23 22:39:51.957878 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Name: Default Jun 23 22:39:51.957878 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Id: 2735e40fe2564a6d8a5cdc7c32b0b869 Jun 23 22:39:51.957878 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Name: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:39:51.957878 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Role: reader,member Jun 23 22:39:51.957878 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Roles: reader,member Jun 23 22:39:51.959591 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2735e40fe2564a6d8a5cdc7c32b0b869", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:39:51.959591 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:39:51.959591 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Id: 2735e40fe2564a6d8a5cdc7c32b0b869 Jun 23 22:39:51.959591 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:39:51.959591 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User: tempest-AttachVolumeNegativeTest-184787456-project Jun 23 22:39:51.959591 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Id: default Jun 23 22:39:51.959591 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Name: Default Jun 23 22:39:51.959591 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Id: 03486c7630314392b85271455d12aba2 Jun 23 22:39:51.959591 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Name: tempest-AttachVolumeNegativeTest-184787456-project Jun 23 22:39:51.959591 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Jun 23 22:39:51.959591 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: {"volumeAttachment": {"volumeId": "00ed731e-c77b-464f-90cf-6ff5fdc8faca"}} Jun 23 22:39:51.959591 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: method: > Jun 23 22:39:51.960407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: exception: Invalid volume: volume 00ed731e-c77b-464f-90cf-6ff5fdc8faca is already attached to instances: cd22650e-6851-4f81-a8d4-e4c7ade26c73 Jun 23 22:39:51.960407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: action_args: {'server_id': '384878db-4705-4f7b-87ff-0f079208412f', 'body': {'volumeAttachment': {'volumeId': '00ed731e-c77b-464f-90cf-6ff5fdc8faca'}}} Jun 23 22:39:51.960407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:39:51.960407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:39:51.960407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 23 22:39:51.960407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 23 22:39:51.960407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 22:39:51.960407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 22:39:51.960407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 23 22:39:51.960407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 23 22:39:51.960407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 23 22:39:51.960407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 23 22:39:51.960407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 23 22:39:51.960407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 23 22:39:51.960407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 00ed731e-c77b-464f-90cf-6ff5fdc8faca is already attached to instances: cd22650e-6851-4f81-a8d4-e4c7ade26c73 Jun 23 22:39:51.960407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:39:51.960407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:39:51.960407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:39:51.960407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:39:51.961821 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:39:51.961821 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:39:51.961821 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:39:51.961821 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:39:51.961821 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:39:51.961821 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:39:51.961821 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 22:39:51.961821 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 22:39:51.961821 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 22:39:51.961821 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 22:39:51.961821 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 22:39:51.961821 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 22:39:51.961821 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 23 22:39:51.961821 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 23 22:39:51.961821 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 00ed731e-c77b-464f-90cf-6ff5fdc8faca is already attached to instances: cd22650e-6851-4f81-a8d4-e4c7ade26c73 Jun 23 22:39:51.961821 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:39:51.961821 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:39:51.961821 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:39:51.961821 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:39:51.961821 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:39:51.963375 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:39:51.963375 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:39:51.963375 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:39:51.963375 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 00ed731e-c77b-464f-90cf-6ff5fdc8faca is already attached to instances: cd22650e-6851-4f81-a8d4-e4c7ade26c73 Jun 23 22:39:51.963375 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:39:51.963375 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-6fba0c08-684b-49c5-8fb1-078b86d1221f tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Returning 400 to user: Invalid volume: volume 00ed731e-c77b-464f-90cf-6ff5fdc8faca is already attached to instances: cd22650e-6851-4f81-a8d4-e4c7ade26c73 {{(pid=124357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:39:51.963375 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-6fba0c08-684b-49c5-8fb1-078b86d1221f tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "POST /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095763 Jun 23 22:39:51.963375 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 226/427] 10.222.0.43 () {60 vars in 1322 bytes} [Thu Jun 23 22:39:51 2022] POST /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 22:39:51.968913 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-59591b68-65a4-4f1e-8d54-04fdbdae1995 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:51.969535 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-59591b68-65a4-4f1e-8d54-04fdbdae1995 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: 384878db-4705-4f7b-87ff-0f079208412f] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:51.975463 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-59591b68-65a4-4f1e-8d54-04fdbdae1995 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:51.975916 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-59591b68-65a4-4f1e-8d54-04fdbdae1995 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:51.976677 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-59591b68-65a4-4f1e-8d54-04fdbdae1995 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:51.977109 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-59591b68-65a4-4f1e-8d54-04fdbdae1995 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:52.002823 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-59591b68-65a4-4f1e-8d54-04fdbdae1995 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: 384878db-4705-4f7b-87ff-0f079208412f] Going to try to terminate instance {{(pid=124358) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:39:52.079532 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-59591b68-65a4-4f1e-8d54-04fdbdae1995 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "DELETE /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f" status: 204 len: 0 microversion: 2.1 time: 0.113820 Jun 23 22:39:52.080118 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 202/428] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 23 22:39:51 2022] DELETE /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 22:39:52.088106 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-1dbf3828-b43e-4b54-b2fe-afef334e1af7 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:52.088763 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-1dbf3828-b43e-4b54-b2fe-afef334e1af7 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: 384878db-4705-4f7b-87ff-0f079208412f] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:52.098334 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1dbf3828-b43e-4b54-b2fe-afef334e1af7 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:52.098786 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1dbf3828-b43e-4b54-b2fe-afef334e1af7 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:52.099550 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1dbf3828-b43e-4b54-b2fe-afef334e1af7 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:52.099976 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1dbf3828-b43e-4b54-b2fe-afef334e1af7 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:52.128599 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-5758f3c6-8b1c-4523-921a-7ed0cf98fee6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:52.128599 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-5758f3c6-8b1c-4523-921a-7ed0cf98fee6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:52.135214 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5758f3c6-8b1c-4523-921a-7ed0cf98fee6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:52.135658 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5758f3c6-8b1c-4523-921a-7ed0cf98fee6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:52.136423 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5758f3c6-8b1c-4523-921a-7ed0cf98fee6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:52.136849 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5758f3c6-8b1c-4523-921a-7ed0cf98fee6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:52.280381 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-1dbf3828-b43e-4b54-b2fe-afef334e1af7 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:52.289131 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-1dbf3828-b43e-4b54-b2fe-afef334e1af7 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f" status: 200 len: 1681 microversion: 2.1 time: 0.204768 Jun 23 22:39:52.289825 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 227/429] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:52 2022] GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f => generated 1681 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:52.310170 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-5758f3c6-8b1c-4523-921a-7ed0cf98fee6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:52.318040 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-5758f3c6-8b1c-4523-921a-7ed0cf98fee6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1661 microversion: 2.1 time: 0.194225 Jun 23 22:39:52.318602 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 203/430] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:52 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1661 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:52.823533 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-11759d43-6525-4ced-af87-b2c407ac90f9 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:52.824138 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-11759d43-6525-4ced-af87-b2c407ac90f9 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:52.831290 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-11759d43-6525-4ced-af87-b2c407ac90f9 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:52.831726 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-11759d43-6525-4ced-af87-b2c407ac90f9 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:52.832476 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-11759d43-6525-4ced-af87-b2c407ac90f9 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:52.832897 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-11759d43-6525-4ced-af87-b2c407ac90f9 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:52.836875 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:39:52.964862 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-11759d43-6525-4ced-af87-b2c407ac90f9 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:52.972304 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-11759d43-6525-4ced-af87-b2c407ac90f9 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1259 microversion: 2.1 time: 0.152648 Jun 23 22:39:52.972861 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 228/431] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:52 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:53.308122 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-fb2edc80-5783-4ffd-8c37-e779d8cf345c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:53.308729 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-fb2edc80-5783-4ffd-8c37-e779d8cf345c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: 384878db-4705-4f7b-87ff-0f079208412f] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:53.315752 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fb2edc80-5783-4ffd-8c37-e779d8cf345c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:53.316184 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fb2edc80-5783-4ffd-8c37-e779d8cf345c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:53.316928 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fb2edc80-5783-4ffd-8c37-e779d8cf345c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:53.317344 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fb2edc80-5783-4ffd-8c37-e779d8cf345c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:53.335200 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-e6444275-c906-4337-8233-c01a2dacbfdc tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:53.335812 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-e6444275-c906-4337-8233-c01a2dacbfdc tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:53.341706 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-e6444275-c906-4337-8233-c01a2dacbfdc tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:53.342152 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-e6444275-c906-4337-8233-c01a2dacbfdc tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:53.342906 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-e6444275-c906-4337-8233-c01a2dacbfdc tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:53.343365 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-e6444275-c906-4337-8233-c01a2dacbfdc tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:53.512615 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-fb2edc80-5783-4ffd-8c37-e779d8cf345c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:53.516151 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:39:53.519528 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-e6444275-c906-4337-8233-c01a2dacbfdc tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:53.521450 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-fb2edc80-5783-4ffd-8c37-e779d8cf345c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f" status: 200 len: 1681 microversion: 2.1 time: 0.217171 Jun 23 22:39:53.522013 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 204/432] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:53 2022] GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f => generated 1681 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:53.526972 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-e6444275-c906-4337-8233-c01a2dacbfdc tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1665 microversion: 2.1 time: 0.195600 Jun 23 22:39:53.527527 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 229/433] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:53 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1665 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:39:53.989018 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-ef284d32-8d0d-4836-aba9-20a2c02e191f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:53.989606 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-ef284d32-8d0d-4836-aba9-20a2c02e191f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:53.999391 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ef284d32-8d0d-4836-aba9-20a2c02e191f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:53.999391 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ef284d32-8d0d-4836-aba9-20a2c02e191f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:53.999391 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ef284d32-8d0d-4836-aba9-20a2c02e191f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:53.999391 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ef284d32-8d0d-4836-aba9-20a2c02e191f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:54.128183 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ef284d32-8d0d-4836-aba9-20a2c02e191f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:54.135744 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-ef284d32-8d0d-4836-aba9-20a2c02e191f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1259 microversion: 2.1 time: 0.150784 Jun 23 22:39:54.136303 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 205/434] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:53 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:54.539726 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-3134cd40-300b-4cc2-adc8-e79848e1793f tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:54.540329 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-3134cd40-300b-4cc2-adc8-e79848e1793f tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: 384878db-4705-4f7b-87ff-0f079208412f] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:54.542582 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell0:SELECT=2 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:39:54.548104 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3134cd40-300b-4cc2-adc8-e79848e1793f tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:54.548632 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3134cd40-300b-4cc2-adc8-e79848e1793f tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:54.549390 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3134cd40-300b-4cc2-adc8-e79848e1793f tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:54.549816 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3134cd40-300b-4cc2-adc8-e79848e1793f tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:54.681142 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-3134cd40-300b-4cc2-adc8-e79848e1793f tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:54.689554 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-3134cd40-300b-4cc2-adc8-e79848e1793f tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f" status: 200 len: 1681 microversion: 2.1 time: 0.153365 Jun 23 22:39:54.690112 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 230/435] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:54 2022] GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:55.153058 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-061a1f73-c90e-4e7c-af18-fbe96f5445fe tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:55.154332 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-061a1f73-c90e-4e7c-af18-fbe96f5445fe tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:55.156289 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=2 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:39:55.157257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=6 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:39:55.165111 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-061a1f73-c90e-4e7c-af18-fbe96f5445fe tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:55.165620 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-061a1f73-c90e-4e7c-af18-fbe96f5445fe tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:55.166448 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-061a1f73-c90e-4e7c-af18-fbe96f5445fe tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:55.167010 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-061a1f73-c90e-4e7c-af18-fbe96f5445fe tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:55.442752 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-061a1f73-c90e-4e7c-af18-fbe96f5445fe tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:55.450334 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-061a1f73-c90e-4e7c-af18-fbe96f5445fe tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1259 microversion: 2.1 time: 0.301085 Jun 23 22:39:55.450902 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 206/436] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:55 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1259 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:55.707535 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-80c78cb4-59c8-4aaf-9655-ee94b5343335 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:55.708738 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-80c78cb4-59c8-4aaf-9655-ee94b5343335 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: 384878db-4705-4f7b-87ff-0f079208412f] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:55.714953 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-80c78cb4-59c8-4aaf-9655-ee94b5343335 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:55.715411 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-80c78cb4-59c8-4aaf-9655-ee94b5343335 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:55.716181 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-80c78cb4-59c8-4aaf-9655-ee94b5343335 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:55.716608 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-80c78cb4-59c8-4aaf-9655-ee94b5343335 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:55.792399 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-80c78cb4-59c8-4aaf-9655-ee94b5343335 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:55.801888 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-80c78cb4-59c8-4aaf-9655-ee94b5343335 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f" status: 200 len: 1614 microversion: 2.1 time: 0.098768 Jun 23 22:39:55.802467 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 231/437] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:55 2022] GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f => generated 1614 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:55.968488 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-bae82c8c-2e52-4c09-9a94-26ce64e8bdd1 req-820a84d4-1313-40e1-bd72-95b7de2c2185 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "384878db-4705-4f7b-87ff-0f079208412f", "name": "network-vif-deleted", "tag": "f64c1270-e6bb-4c22-97a6-eb4fedf23371"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:39:55.982212 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-bae82c8c-2e52-4c09-9a94-26ce64e8bdd1 req-820a84d4-1313-40e1-bd72-95b7de2c2185 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:55.982989 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-bae82c8c-2e52-4c09-9a94-26ce64e8bdd1 req-820a84d4-1313-40e1-bd72-95b7de2c2185 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:56.001011 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-bae82c8c-2e52-4c09-9a94-26ce64e8bdd1 req-820a84d4-1313-40e1-bd72-95b7de2c2185 service nova] Creating event network-vif-deleted:f64c1270-e6bb-4c22-97a6-eb4fedf23371 for instance 384878db-4705-4f7b-87ff-0f079208412f on hv-cinder-84617 Jun 23 22:39:56.008080 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-bae82c8c-2e52-4c09-9a94-26ce64e8bdd1 req-820a84d4-1313-40e1-bd72-95b7de2c2185 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043667 Jun 23 22:39:56.009011 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 207/438] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:39:56.468121 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-95eb0ffd-a2df-4bf3-8da0-7ba25cbc025f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:56.468966 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-95eb0ffd-a2df-4bf3-8da0-7ba25cbc025f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:56.475846 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-95eb0ffd-a2df-4bf3-8da0-7ba25cbc025f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:56.476362 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-95eb0ffd-a2df-4bf3-8da0-7ba25cbc025f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:56.477223 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-95eb0ffd-a2df-4bf3-8da0-7ba25cbc025f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:56.477713 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-95eb0ffd-a2df-4bf3-8da0-7ba25cbc025f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:56.640530 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-95eb0ffd-a2df-4bf3-8da0-7ba25cbc025f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:56.650321 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-95eb0ffd-a2df-4bf3-8da0-7ba25cbc025f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1259 microversion: 2.1 time: 0.186194 Jun 23 22:39:56.651570 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 232/439] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:56 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1259 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:56.820976 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-ff5aec75-5d8a-4b36-a678-059887395739 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:56.822205 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-ff5aec75-5d8a-4b36-a678-059887395739 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: 384878db-4705-4f7b-87ff-0f079208412f] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:56.830963 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ff5aec75-5d8a-4b36-a678-059887395739 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:56.831413 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ff5aec75-5d8a-4b36-a678-059887395739 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:56.832519 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ff5aec75-5d8a-4b36-a678-059887395739 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:56.832956 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ff5aec75-5d8a-4b36-a678-059887395739 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:56.873580 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ff5aec75-5d8a-4b36-a678-059887395739 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:56.874059 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ff5aec75-5d8a-4b36-a678-059887395739 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:56.874516 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.objects.instance [None req-ff5aec75-5d8a-4b36-a678-059887395739 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lazy-loading 'fault' on Instance uuid 384878db-4705-4f7b-87ff-0f079208412f {{(pid=124358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:39:56.927972 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ff5aec75-5d8a-4b36-a678-059887395739 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:56.940844 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-ff5aec75-5d8a-4b36-a678-059887395739 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f" status: 200 len: 1331 microversion: 2.1 time: 0.123618 Jun 23 22:39:56.941825 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 208/440] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:56 2022] GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f => generated 1331 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:39:57.225917 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [req-cad90efa-88c9-40d6-b21e-226531eb69f6 req-ec50fe68-3cab-4d81-bf3d-0b562c2cb608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "628515ea-c2f6-490f-a67d-13d0e97698ac", "name": "network-vif-plugged", "status": "completed", "tag": "0b2f39d0-0fe2-4db8-9e32-5112a69d2b21"}]} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:39:57.237974 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-cad90efa-88c9-40d6-b21e-226531eb69f6 req-ec50fe68-3cab-4d81-bf3d-0b562c2cb608 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:57.238852 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-cad90efa-88c9-40d6-b21e-226531eb69f6 req-ec50fe68-3cab-4d81-bf3d-0b562c2cb608 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:57.259227 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.compute.server_external_events [req-cad90efa-88c9-40d6-b21e-226531eb69f6 req-ec50fe68-3cab-4d81-bf3d-0b562c2cb608 service nova] Creating event network-vif-plugged:0b2f39d0-0fe2-4db8-9e32-5112a69d2b21 for instance 628515ea-c2f6-490f-a67d-13d0e97698ac on hv-cinder-84617 Jun 23 22:39:57.265836 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [req-cad90efa-88c9-40d6-b21e-226531eb69f6 req-ec50fe68-3cab-4d81-bf3d-0b562c2cb608 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044330 Jun 23 22:39:57.267526 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 233/441] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:39:57.669221 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-9c45d0f5-a705-4717-aaa5-1b8527529e70 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:57.669770 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-9c45d0f5-a705-4717-aaa5-1b8527529e70 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:57.676492 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9c45d0f5-a705-4717-aaa5-1b8527529e70 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:57.677471 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9c45d0f5-a705-4717-aaa5-1b8527529e70 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:57.677745 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9c45d0f5-a705-4717-aaa5-1b8527529e70 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:57.678138 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9c45d0f5-a705-4717-aaa5-1b8527529e70 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:57.808673 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-9c45d0f5-a705-4717-aaa5-1b8527529e70 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:57.816380 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-9c45d0f5-a705-4717-aaa5-1b8527529e70 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1259 microversion: 2.1 time: 0.151191 Jun 23 22:39:57.816951 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 209/442] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:57 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:57.960820 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-7cba8e58-6a46-42f7-8782-d908ef8a2dc7 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:57.961497 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-7cba8e58-6a46-42f7-8782-d908ef8a2dc7 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: 384878db-4705-4f7b-87ff-0f079208412f] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:57.968292 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7cba8e58-6a46-42f7-8782-d908ef8a2dc7 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:57.968742 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7cba8e58-6a46-42f7-8782-d908ef8a2dc7 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:57.969503 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7cba8e58-6a46-42f7-8782-d908ef8a2dc7 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:57.969959 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7cba8e58-6a46-42f7-8782-d908ef8a2dc7 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:58.018623 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7cba8e58-6a46-42f7-8782-d908ef8a2dc7 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:58.019120 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7cba8e58-6a46-42f7-8782-d908ef8a2dc7 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:58.019584 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.objects.instance [None req-7cba8e58-6a46-42f7-8782-d908ef8a2dc7 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lazy-loading 'fault' on Instance uuid 384878db-4705-4f7b-87ff-0f079208412f {{(pid=124357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:39:58.080815 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-7cba8e58-6a46-42f7-8782-d908ef8a2dc7 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:58.089665 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-7cba8e58-6a46-42f7-8782-d908ef8a2dc7 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f" status: 200 len: 1331 microversion: 2.1 time: 0.134906 Jun 23 22:39:58.090548 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 234/443] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:57 2022] GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f => generated 1331 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:58.310271 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-eb131d44-a574-4e14-a249-fd6e7fbf4a78 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:39:58.311303 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-eb131d44-a574-4e14-a249-fd6e7fbf4a78 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:58.318050 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-eb131d44-a574-4e14-a249-fd6e7fbf4a78 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:58.318477 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-eb131d44-a574-4e14-a249-fd6e7fbf4a78 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:58.319268 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-eb131d44-a574-4e14-a249-fd6e7fbf4a78 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:58.319701 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-eb131d44-a574-4e14-a249-fd6e7fbf4a78 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:58.341723 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.objects.instance [None req-eb131d44-a574-4e14-a249-fd6e7fbf4a78 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lazy-loading 'flavor' on Instance uuid 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b {{(pid=124358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:39:58.500002 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-eb131d44-a574-4e14-a249-fd6e7fbf4a78 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "POST /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b/action" status: 200 len: 32 microversion: 2.1 time: 0.193616 Jun 23 22:39:58.500567 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 210/444] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Jun 23 22:39:58 2022] POST /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b/action => generated 32 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 22:39:58.511186 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-83edec95-b6bc-403b-8a3e-378ddfc4c031 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:58.511893 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-83edec95-b6bc-403b-8a3e-378ddfc4c031 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:58.519997 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-83edec95-b6bc-403b-8a3e-378ddfc4c031 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:58.520531 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-83edec95-b6bc-403b-8a3e-378ddfc4c031 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:58.522050 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-83edec95-b6bc-403b-8a3e-378ddfc4c031 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:58.522522 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-83edec95-b6bc-403b-8a3e-378ddfc4c031 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:58.736372 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-83edec95-b6bc-403b-8a3e-378ddfc4c031 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:58.744487 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-83edec95-b6bc-403b-8a3e-378ddfc4c031 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1735 microversion: 2.1 time: 0.237189 Jun 23 22:39:58.745052 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 235/445] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:58 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1735 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:58.832743 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-5b10ad9f-6aa1-44a8-a1d0-7f5e0e7b4b50 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:58.833432 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-5b10ad9f-6aa1-44a8-a1d0-7f5e0e7b4b50 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:58.839604 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5b10ad9f-6aa1-44a8-a1d0-7f5e0e7b4b50 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:58.840045 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5b10ad9f-6aa1-44a8-a1d0-7f5e0e7b4b50 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:58.840795 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5b10ad9f-6aa1-44a8-a1d0-7f5e0e7b4b50 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:58.841222 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5b10ad9f-6aa1-44a8-a1d0-7f5e0e7b4b50 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:58.971688 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-5b10ad9f-6aa1-44a8-a1d0-7f5e0e7b4b50 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:58.978994 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-5b10ad9f-6aa1-44a8-a1d0-7f5e0e7b4b50 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1259 microversion: 2.1 time: 0.150509 Jun 23 22:39:58.979548 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 211/446] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:58 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:59.108509 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-03ea5006-99d3-40d3-9e68-c4094fac1157 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:59.109040 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-03ea5006-99d3-40d3-9e68-c4094fac1157 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: 384878db-4705-4f7b-87ff-0f079208412f] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:59.115233 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-03ea5006-99d3-40d3-9e68-c4094fac1157 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:59.115678 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-03ea5006-99d3-40d3-9e68-c4094fac1157 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:59.116429 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-03ea5006-99d3-40d3-9e68-c4094fac1157 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:59.116858 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-03ea5006-99d3-40d3-9e68-c4094fac1157 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:59.130618 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.wsgi [None req-03ea5006-99d3-40d3-9e68-c4094fac1157 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] HTTP exception thrown: Instance 384878db-4705-4f7b-87ff-0f079208412f could not be found. Jun 23 22:39:59.132347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-03ea5006-99d3-40d3-9e68-c4094fac1157 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Request method failure captured: Jun 23 22:39:59.132347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: request: GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f HTTP/1.1 Jun 23 22:39:59.132347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept: application/json Jun 23 22:39:59.132347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept-Encoding: identity Jun 23 22:39:59.132347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Connection: close Jun 23 22:39:59.132347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Length: 0 Jun 23 22:39:59.132347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Type: application/json Jun 23 22:39:59.132347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Host: 10.222.0.43 Jun 23 22:39:59.132347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Openstack-System-Scope: None Jun 23 22:39:59.132347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: User-Agent: python-urllib3/1.26.9 Jun 23 22:39:59.132347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Auth-Token: gAAAAABitOrWyDITCi2PmBTdDblZ-ZSwK9B2UK_lIIWOMJB9Z-7YhxsoOI1DrhAeUCIChTCXv2hii5VV1HcTnkYXbW5bgXE95MCdJVwhuPtEsdt8Afqc-N7hZn6zZkza9EI9jSK71KcKdXUQCp4unsH4J6JfPLYATxcY6NVUnHVlcszTDCqSUi0 Jun 23 22:39:59.132347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Id: None Jun 23 22:39:59.132347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Name: None Jun 23 22:39:59.132347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Identity-Status: Confirmed Jun 23 22:39:59.132347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Is-Admin-Project: True Jun 23 22:39:59.132347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Id: default Jun 23 22:39:59.132347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Name: Default Jun 23 22:39:59.132347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Id: 2735e40fe2564a6d8a5cdc7c32b0b869 Jun 23 22:39:59.132347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Name: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:39:59.132347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Role: reader,member Jun 23 22:39:59.132347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Roles: reader,member Jun 23 22:39:59.133949 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2735e40fe2564a6d8a5cdc7c32b0b869", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:39:59.133949 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:39:59.133949 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Id: 2735e40fe2564a6d8a5cdc7c32b0b869 Jun 23 22:39:59.133949 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:39:59.133949 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User: tempest-AttachVolumeNegativeTest-184787456-project Jun 23 22:39:59.133949 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Id: default Jun 23 22:39:59.133949 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Name: Default Jun 23 22:39:59.133949 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Id: 03486c7630314392b85271455d12aba2 Jun 23 22:39:59.133949 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Name: tempest-AttachVolumeNegativeTest-184787456-project Jun 23 22:39:59.133949 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: method: > Jun 23 22:39:59.133949 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: exception: Instance 384878db-4705-4f7b-87ff-0f079208412f could not be found. Jun 23 22:39:59.133949 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: action_args: {'id': '384878db-4705-4f7b-87ff-0f079208412f'} Jun 23 22:39:59.134824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:39:59.134824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:39:59.134824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:39:59.134824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:39:59.134824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:39:59.134824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:39:59.134824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:39:59.134824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:39:59.134824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:39:59.134824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:39:59.134824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 384878db-4705-4f7b-87ff-0f079208412f could not be found. Jun 23 22:39:59.134824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:39:59.134824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:39:59.134824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:39:59.134824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:39:59.134824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:39:59.134824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:39:59.134824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:39:59.134824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:39:59.134824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:39:59.136423 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:39:59.136423 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:39:59.136423 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:39:59.136423 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:39:59.136423 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:39:59.136423 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:39:59.136423 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:39:59.136423 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 384878db-4705-4f7b-87ff-0f079208412f could not be found. Jun 23 22:39:59.136423 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:39:59.136423 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:39:59.136423 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:39:59.136423 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:39:59.136423 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:39:59.136423 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:39:59.136423 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:39:59.136423 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:39:59.136423 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 384878db-4705-4f7b-87ff-0f079208412f could not be found. Jun 23 22:39:59.136423 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:39:59.137705 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-03ea5006-99d3-40d3-9e68-c4094fac1157 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Returning 404 to user: Instance 384878db-4705-4f7b-87ff-0f079208412f could not be found. {{(pid=124357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:39:59.137705 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-03ea5006-99d3-40d3-9e68-c4094fac1157 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f" status: 404 len: 111 microversion: 2.1 time: 0.029252 Jun 23 22:39:59.137705 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 236/447] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:59 2022] GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:39:59.143207 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-0eb8eef9-aa60-408b-9166-c1b68153092b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '.version_select at 0x7fb71a07f670>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:59.174565 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-0eb8eef9-aa60-408b-9166-c1b68153092b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1455506355" status: 202 len: 0 microversion: 2.1 time: 0.035809 Jun 23 22:39:59.175176 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 212/448] 10.222.0.43 () {58 vars in 1220 bytes} [Thu Jun 23 22:39:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1455506355 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:39:59.761972 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-f017bd03-a460-439a-8205-986b43093f16 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:59.763291 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-f017bd03-a460-439a-8205-986b43093f16 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:59.771525 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f017bd03-a460-439a-8205-986b43093f16 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:59.772070 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f017bd03-a460-439a-8205-986b43093f16 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:59.772904 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f017bd03-a460-439a-8205-986b43093f16 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:59.773394 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f017bd03-a460-439a-8205-986b43093f16 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:59.851461 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-7ab1c137-dfcf-4b45-afa5-15a5493e9254 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:59.851979 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-7ab1c137-dfcf-4b45-afa5-15a5493e9254 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: cd22650e-6851-4f81-a8d4-e4c7ade26c73] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:39:59.858564 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7ab1c137-dfcf-4b45-afa5-15a5493e9254 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:59.859040 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7ab1c137-dfcf-4b45-afa5-15a5493e9254 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:59.859797 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7ab1c137-dfcf-4b45-afa5-15a5493e9254 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:39:59.860224 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7ab1c137-dfcf-4b45-afa5-15a5493e9254 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:39:59.905904 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-f017bd03-a460-439a-8205-986b43093f16 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:39:59.914351 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-f017bd03-a460-439a-8205-986b43093f16 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1735 microversion: 2.1 time: 0.156583 Jun 23 22:39:59.915016 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 237/449] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:59 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:59.944550 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.objects.instance [None req-7ab1c137-dfcf-4b45-afa5-15a5493e9254 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lazy-loading 'services' on Instance uuid cd22650e-6851-4f81-a8d4-e4c7ade26c73 {{(pid=124358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:39:59.995983 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-d5996104-df8d-4c02-8d5c-74f11264a252 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:59.996629 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-d5996104-df8d-4c02-8d5c-74f11264a252 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:00.003647 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d5996104-df8d-4c02-8d5c-74f11264a252 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:00.004096 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d5996104-df8d-4c02-8d5c-74f11264a252 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:00.004870 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d5996104-df8d-4c02-8d5c-74f11264a252 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:00.005310 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d5996104-df8d-4c02-8d5c-74f11264a252 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:00.016271 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-7ab1c137-dfcf-4b45-afa5-15a5493e9254 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "DELETE /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73/os-volume_attachments/00ed731e-c77b-464f-90cf-6ff5fdc8faca" status: 202 len: 0 microversion: 2.1 time: 0.168984 Jun 23 22:40:00.017763 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 213/450] 10.222.0.43 () {58 vars in 1415 bytes} [Thu Jun 23 22:39:59 2022] DELETE /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73/os-volume_attachments/00ed731e-c77b-464f-90cf-6ff5fdc8faca => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 22:40:00.025441 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-db11cc62-85f2-4a9a-a426-4dcf283fa44a tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:00.026499 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-db11cc62-85f2-4a9a-a426-4dcf283fa44a tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: cd22650e-6851-4f81-a8d4-e4c7ade26c73] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:00.032628 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-db11cc62-85f2-4a9a-a426-4dcf283fa44a tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:00.033071 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-db11cc62-85f2-4a9a-a426-4dcf283fa44a tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:00.033821 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-db11cc62-85f2-4a9a-a426-4dcf283fa44a tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:00.034273 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-db11cc62-85f2-4a9a-a426-4dcf283fa44a tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:00.065578 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-db11cc62-85f2-4a9a-a426-4dcf283fa44a tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044071 Jun 23 22:40:00.066147 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 214/451] 10.222.0.43 () {58 vars in 1301 bytes} [Thu Jun 23 22:40:00 2022] GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:40:00.136976 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-d5996104-df8d-4c02-8d5c-74f11264a252 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:00.144392 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-d5996104-df8d-4c02-8d5c-74f11264a252 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1259 microversion: 2.1 time: 0.152235 Jun 23 22:40:00.144942 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 238/452] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:39:59 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:40:00.933483 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a1c2a2d5-c9dc-465c-9a0a-a0955ff20528 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:00.934046 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-a1c2a2d5-c9dc-465c-9a0a-a0955ff20528 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:00.941280 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a1c2a2d5-c9dc-465c-9a0a-a0955ff20528 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:00.941731 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a1c2a2d5-c9dc-465c-9a0a-a0955ff20528 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:00.942510 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a1c2a2d5-c9dc-465c-9a0a-a0955ff20528 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:00.942960 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a1c2a2d5-c9dc-465c-9a0a-a0955ff20528 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:01.077391 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-f648ec54-f8c4-41a9-93a4-eddca0f2451e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:01.078308 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-f648ec54-f8c4-41a9-93a4-eddca0f2451e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: cd22650e-6851-4f81-a8d4-e4c7ade26c73] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:01.085574 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f648ec54-f8c4-41a9-93a4-eddca0f2451e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:01.086017 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f648ec54-f8c4-41a9-93a4-eddca0f2451e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:01.086775 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f648ec54-f8c4-41a9-93a4-eddca0f2451e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:01.087229 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f648ec54-f8c4-41a9-93a4-eddca0f2451e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:01.117312 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-f648ec54-f8c4-41a9-93a4-eddca0f2451e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043795 Jun 23 22:40:01.117889 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 239/453] 10.222.0.43 () {58 vars in 1301 bytes} [Thu Jun 23 22:40:01 2022] GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:40:01.161060 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-8ee2c62c-61a7-47ea-bb3b-f3bc0fc25b8e tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:01.161694 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-8ee2c62c-61a7-47ea-bb3b-f3bc0fc25b8e tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:01.168170 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-8ee2c62c-61a7-47ea-bb3b-f3bc0fc25b8e tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:01.168609 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-8ee2c62c-61a7-47ea-bb3b-f3bc0fc25b8e tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:01.169357 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-8ee2c62c-61a7-47ea-bb3b-f3bc0fc25b8e tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:01.169800 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-8ee2c62c-61a7-47ea-bb3b-f3bc0fc25b8e tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:01.302019 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-a1c2a2d5-c9dc-465c-9a0a-a0955ff20528 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:01.310062 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-a1c2a2d5-c9dc-465c-9a0a-a0955ff20528 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1735 microversion: 2.1 time: 0.381470 Jun 23 22:40:01.310629 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 215/454] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:00 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1735 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:40:01.334028 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-8ee2c62c-61a7-47ea-bb3b-f3bc0fc25b8e tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:01.341533 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-8ee2c62c-61a7-47ea-bb3b-f3bc0fc25b8e tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1442 microversion: 2.1 time: 0.184446 Jun 23 22:40:01.342091 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 240/455] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:01 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1442 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:40:01.357674 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-3f88b8c9-33a9-45f9-a485-62281c307eb9 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:01.358281 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-3f88b8c9-33a9-45f9-a485-62281c307eb9 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:01.368621 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3f88b8c9-33a9-45f9-a485-62281c307eb9 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:01.369096 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3f88b8c9-33a9-45f9-a485-62281c307eb9 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:01.369865 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3f88b8c9-33a9-45f9-a485-62281c307eb9 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:01.370293 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3f88b8c9-33a9-45f9-a485-62281c307eb9 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:01.568813 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-3f88b8c9-33a9-45f9-a485-62281c307eb9 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:01.576197 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-3f88b8c9-33a9-45f9-a485-62281c307eb9 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1442 microversion: 2.1 time: 0.222782 Jun 23 22:40:01.576757 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 216/456] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:01 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1442 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:40:02.129038 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-cc979c81-5f35-496a-ad01-e0ab2db3f722 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:02.130333 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-cc979c81-5f35-496a-ad01-e0ab2db3f722 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: cd22650e-6851-4f81-a8d4-e4c7ade26c73] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:02.136531 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-cc979c81-5f35-496a-ad01-e0ab2db3f722 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:02.136975 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-cc979c81-5f35-496a-ad01-e0ab2db3f722 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:02.137788 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-cc979c81-5f35-496a-ad01-e0ab2db3f722 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:02.138214 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-cc979c81-5f35-496a-ad01-e0ab2db3f722 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:02.169600 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-cc979c81-5f35-496a-ad01-e0ab2db3f722 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044764 Jun 23 22:40:02.170493 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 241/457] 10.222.0.43 () {58 vars in 1301 bytes} [Thu Jun 23 22:40:02 2022] GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 22:40:02.231560 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-2cf0526d-5e51-4156-b0d0-cae4f36643c9 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:02.232158 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-2cf0526d-5e51-4156-b0d0-cae4f36643c9 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: cd22650e-6851-4f81-a8d4-e4c7ade26c73] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:02.238742 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2cf0526d-5e51-4156-b0d0-cae4f36643c9 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:02.239212 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2cf0526d-5e51-4156-b0d0-cae4f36643c9 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:02.239970 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2cf0526d-5e51-4156-b0d0-cae4f36643c9 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:02.240392 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2cf0526d-5e51-4156-b0d0-cae4f36643c9 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:02.269072 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-2cf0526d-5e51-4156-b0d0-cae4f36643c9 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: cd22650e-6851-4f81-a8d4-e4c7ade26c73] Going to try to terminate instance {{(pid=124358) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:40:02.327939 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-2d63b208-10ab-4206-9f61-8947b0336d79 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:02.328830 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-2d63b208-10ab-4206-9f61-8947b0336d79 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:02.339920 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2d63b208-10ab-4206-9f61-8947b0336d79 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:02.349344 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-2cf0526d-5e51-4156-b0d0-cae4f36643c9 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "DELETE /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73" status: 204 len: 0 microversion: 2.1 time: 0.121321 Jun 23 22:40:02.349947 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 217/458] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 23 22:40:02 2022] DELETE /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 22:40:02.352380 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2d63b208-10ab-4206-9f61-8947b0336d79 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:02.353508 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2d63b208-10ab-4206-9f61-8947b0336d79 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:02.354907 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2d63b208-10ab-4206-9f61-8947b0336d79 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:02.358610 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-4c48a191-de95-4f7c-824c-502598cdcfab tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:02.359337 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-4c48a191-de95-4f7c-824c-502598cdcfab tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: cd22650e-6851-4f81-a8d4-e4c7ade26c73] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:02.366056 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4c48a191-de95-4f7c-824c-502598cdcfab tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:02.366502 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4c48a191-de95-4f7c-824c-502598cdcfab tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:02.367313 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4c48a191-de95-4f7c-824c-502598cdcfab tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:02.367925 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4c48a191-de95-4f7c-824c-502598cdcfab tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:02.387299 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:40:02.650833 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-2d63b208-10ab-4206-9f61-8947b0336d79 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:02.658945 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-2d63b208-10ab-4206-9f61-8947b0336d79 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1735 microversion: 2.1 time: 0.335032 Jun 23 22:40:02.659517 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 242/459] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:02 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1735 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:40:02.692931 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4c48a191-de95-4f7c-824c-502598cdcfab tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:02.700511 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-4c48a191-de95-4f7c-824c-502598cdcfab tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73" status: 200 len: 1681 microversion: 2.1 time: 0.346039 Jun 23 22:40:02.701162 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 218/460] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:02 2022] GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73 => generated 1681 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:40:03.536686 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [req-3f6712d4-210b-41d7-94c5-39ab6e41d7ce req-ad517e6f-4444-418e-af6d-910cd513c19f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "628515ea-c2f6-490f-a67d-13d0e97698ac", "tag": "0b2f39d0-0fe2-4db8-9e32-5112a69d2b21"}]} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:40:03.545966 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-3f6712d4-210b-41d7-94c5-39ab6e41d7ce req-ad517e6f-4444-418e-af6d-910cd513c19f service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:03.546492 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-3f6712d4-210b-41d7-94c5-39ab6e41d7ce req-ad517e6f-4444-418e-af6d-910cd513c19f service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:03.559264 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.compute.server_external_events [req-3f6712d4-210b-41d7-94c5-39ab6e41d7ce req-ad517e6f-4444-418e-af6d-910cd513c19f service nova] Creating event network-changed:0b2f39d0-0fe2-4db8-9e32-5112a69d2b21 for instance 628515ea-c2f6-490f-a67d-13d0e97698ac on hv-cinder-84617 Jun 23 22:40:03.564833 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [req-3f6712d4-210b-41d7-94c5-39ab6e41d7ce req-ad517e6f-4444-418e-af6d-910cd513c19f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031252 Jun 23 22:40:03.565423 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 243/461] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:40:03.676428 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c00cf57c-deb4-4cbd-9eb9-6647f0c4026a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:03.676951 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c00cf57c-deb4-4cbd-9eb9-6647f0c4026a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:03.683569 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c00cf57c-deb4-4cbd-9eb9-6647f0c4026a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:03.684011 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c00cf57c-deb4-4cbd-9eb9-6647f0c4026a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:03.684990 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c00cf57c-deb4-4cbd-9eb9-6647f0c4026a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:03.685423 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c00cf57c-deb4-4cbd-9eb9-6647f0c4026a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:03.719141 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-65920956-60f7-4441-9cf3-a36dc70c195d tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:03.719847 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-65920956-60f7-4441-9cf3-a36dc70c195d tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: cd22650e-6851-4f81-a8d4-e4c7ade26c73] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:03.726254 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-65920956-60f7-4441-9cf3-a36dc70c195d tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:03.726709 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-65920956-60f7-4441-9cf3-a36dc70c195d tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:03.727516 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-65920956-60f7-4441-9cf3-a36dc70c195d tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:03.727953 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-65920956-60f7-4441-9cf3-a36dc70c195d tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:03.872599 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c00cf57c-deb4-4cbd-9eb9-6647f0c4026a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:03.881919 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c00cf57c-deb4-4cbd-9eb9-6647f0c4026a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1735 microversion: 2.1 time: 0.210194 Jun 23 22:40:03.892198 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 219/462] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:03 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1735 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:40:03.900777 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-65920956-60f7-4441-9cf3-a36dc70c195d tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:03.908819 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-65920956-60f7-4441-9cf3-a36dc70c195d tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73" status: 200 len: 1681 microversion: 2.1 time: 0.194004 Jun 23 22:40:03.909399 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 244/463] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:03 2022] GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73 => generated 1681 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:40:04.899710 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-fbf9c96f-988d-4f81-a38d-d48c3dab3feb tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:04.900320 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-fbf9c96f-988d-4f81-a38d-d48c3dab3feb tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:04.906917 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fbf9c96f-988d-4f81-a38d-d48c3dab3feb tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:04.907388 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fbf9c96f-988d-4f81-a38d-d48c3dab3feb tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:04.908151 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fbf9c96f-988d-4f81-a38d-d48c3dab3feb tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:04.908579 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fbf9c96f-988d-4f81-a38d-d48c3dab3feb tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:04.926667 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-4e184673-1405-4e3c-b7c4-012d0271a68d tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:04.927389 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-4e184673-1405-4e3c-b7c4-012d0271a68d tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: cd22650e-6851-4f81-a8d4-e4c7ade26c73] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:04.936160 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-4e184673-1405-4e3c-b7c4-012d0271a68d tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:04.936740 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-4e184673-1405-4e3c-b7c4-012d0271a68d tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:04.937591 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-4e184673-1405-4e3c-b7c4-012d0271a68d tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:04.938098 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-4e184673-1405-4e3c-b7c4-012d0271a68d tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:05.135657 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-fbf9c96f-988d-4f81-a38d-d48c3dab3feb tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:05.144700 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-fbf9c96f-988d-4f81-a38d-d48c3dab3feb tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1735 microversion: 2.1 time: 0.248831 Jun 23 22:40:05.145386 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 220/464] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:04 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1735 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:40:05.172209 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-4e184673-1405-4e3c-b7c4-012d0271a68d tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:05.179756 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-4e184673-1405-4e3c-b7c4-012d0271a68d tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73" status: 200 len: 1681 microversion: 2.1 time: 0.257998 Jun 23 22:40:05.180316 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 245/465] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:04 2022] GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73 => generated 1681 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:40:06.162357 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-1af4960c-80ee-4e41-bcb5-80a3625673de tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:06.162937 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-1af4960c-80ee-4e41-bcb5-80a3625673de tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:06.169380 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1af4960c-80ee-4e41-bcb5-80a3625673de tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:06.169816 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1af4960c-80ee-4e41-bcb5-80a3625673de tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:06.170568 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1af4960c-80ee-4e41-bcb5-80a3625673de tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:06.171022 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1af4960c-80ee-4e41-bcb5-80a3625673de tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:06.197247 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-da11284c-e4ad-4b38-8339-802a00f20d5c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:06.197683 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-da11284c-e4ad-4b38-8339-802a00f20d5c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: cd22650e-6851-4f81-a8d4-e4c7ade26c73] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:06.204157 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-da11284c-e4ad-4b38-8339-802a00f20d5c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:06.204591 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-da11284c-e4ad-4b38-8339-802a00f20d5c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:06.205344 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-da11284c-e4ad-4b38-8339-802a00f20d5c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:06.205839 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-da11284c-e4ad-4b38-8339-802a00f20d5c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:06.225095 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell1:SELECT=100 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:40:06.337553 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-da11284c-e4ad-4b38-8339-802a00f20d5c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:06.347116 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-da11284c-e4ad-4b38-8339-802a00f20d5c tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73" status: 200 len: 1613 microversion: 2.1 time: 0.153136 Jun 23 22:40:06.347696 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 246/466] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:06 2022] GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73 => generated 1613 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:40:06.449835 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-1af4960c-80ee-4e41-bcb5-80a3625673de tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:06.457780 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-1af4960c-80ee-4e41-bcb5-80a3625673de tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1735 microversion: 2.1 time: 0.299628 Jun 23 22:40:06.458401 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 221/467] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:06 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1735 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:40:06.612433 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [req-c1009175-bd16-4a9a-b2e4-2858b9d92f88 req-aeafc456-463d-4320-8a53-ba3ae1af2fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd22650e-6851-4f81-a8d4-e4c7ade26c73", "name": "network-vif-deleted", "tag": "e97c4f2f-223c-4f40-b688-f46dae13754f"}]} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:40:06.621390 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-c1009175-bd16-4a9a-b2e4-2858b9d92f88 req-aeafc456-463d-4320-8a53-ba3ae1af2fb6 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:06.621942 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-c1009175-bd16-4a9a-b2e4-2858b9d92f88 req-aeafc456-463d-4320-8a53-ba3ae1af2fb6 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:06.636791 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.compute.server_external_events [req-c1009175-bd16-4a9a-b2e4-2858b9d92f88 req-aeafc456-463d-4320-8a53-ba3ae1af2fb6 service nova] Creating event network-vif-deleted:e97c4f2f-223c-4f40-b688-f46dae13754f for instance cd22650e-6851-4f81-a8d4-e4c7ade26c73 on hv-cinder-84617 Jun 23 22:40:06.645058 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [req-c1009175-bd16-4a9a-b2e4-2858b9d92f88 req-aeafc456-463d-4320-8a53-ba3ae1af2fb6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036438 Jun 23 22:40:06.646304 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 247/468] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:40:07.365190 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-de480a21-65f5-49c9-871d-b40bdf86fc03 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:07.365893 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-de480a21-65f5-49c9-871d-b40bdf86fc03 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: cd22650e-6851-4f81-a8d4-e4c7ade26c73] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:07.371283 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:40:07.376474 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-de480a21-65f5-49c9-871d-b40bdf86fc03 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:07.377053 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-de480a21-65f5-49c9-871d-b40bdf86fc03 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:07.378525 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-de480a21-65f5-49c9-871d-b40bdf86fc03 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:07.378976 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-de480a21-65f5-49c9-871d-b40bdf86fc03 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:07.396002 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-de480a21-65f5-49c9-871d-b40bdf86fc03 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] HTTP exception thrown: Instance cd22650e-6851-4f81-a8d4-e4c7ade26c73 could not be found. Jun 23 22:40:07.397872 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-de480a21-65f5-49c9-871d-b40bdf86fc03 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Request method failure captured: Jun 23 22:40:07.397872 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: request: GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73 HTTP/1.1 Jun 23 22:40:07.397872 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept: application/json Jun 23 22:40:07.397872 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Jun 23 22:40:07.397872 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Connection: close Jun 23 22:40:07.397872 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Length: 0 Jun 23 22:40:07.397872 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Type: application/json Jun 23 22:40:07.397872 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Host: 10.222.0.43 Jun 23 22:40:07.397872 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Jun 23 22:40:07.397872 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.9 Jun 23 22:40:07.397872 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABitOrWyDITCi2PmBTdDblZ-ZSwK9B2UK_lIIWOMJB9Z-7YhxsoOI1DrhAeUCIChTCXv2hii5VV1HcTnkYXbW5bgXE95MCdJVwhuPtEsdt8Afqc-N7hZn6zZkza9EI9jSK71KcKdXUQCp4unsH4J6JfPLYATxcY6NVUnHVlcszTDCqSUi0 Jun 23 22:40:07.397872 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Jun 23 22:40:07.397872 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Jun 23 22:40:07.397872 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Jun 23 22:40:07.397872 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Jun 23 22:40:07.397872 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Jun 23 22:40:07.397872 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Jun 23 22:40:07.397872 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Id: 2735e40fe2564a6d8a5cdc7c32b0b869 Jun 23 22:40:07.397872 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:40:07.397872 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Role: reader,member Jun 23 22:40:07.397872 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Roles: reader,member Jun 23 22:40:07.399448 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2735e40fe2564a6d8a5cdc7c32b0b869", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:40:07.399448 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:40:07.399448 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Id: 2735e40fe2564a6d8a5cdc7c32b0b869 Jun 23 22:40:07.399448 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:40:07.399448 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User: tempest-AttachVolumeNegativeTest-184787456-project Jun 23 22:40:07.399448 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Jun 23 22:40:07.399448 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Jun 23 22:40:07.399448 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Id: 03486c7630314392b85271455d12aba2 Jun 23 22:40:07.399448 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-AttachVolumeNegativeTest-184787456-project Jun 23 22:40:07.399448 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: method: > Jun 23 22:40:07.399448 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: exception: Instance cd22650e-6851-4f81-a8d4-e4c7ade26c73 could not be found. Jun 23 22:40:07.399448 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: action_args: {'id': 'cd22650e-6851-4f81-a8d4-e4c7ade26c73'} Jun 23 22:40:07.400783 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:40:07.400783 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:40:07.400783 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:40:07.400783 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:40:07.400783 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:40:07.400783 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:40:07.400783 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:40:07.400783 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:40:07.400783 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:40:07.400783 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:40:07.400783 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd22650e-6851-4f81-a8d4-e4c7ade26c73 could not be found. Jun 23 22:40:07.400783 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:40:07.400783 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:40:07.400783 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:40:07.400783 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:40:07.400783 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:40:07.400783 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:40:07.400783 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:40:07.400783 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:40:07.400783 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:40:07.402440 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:40:07.402440 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:40:07.402440 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:40:07.402440 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:40:07.402440 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:40:07.402440 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:40:07.402440 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:40:07.402440 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd22650e-6851-4f81-a8d4-e4c7ade26c73 could not be found. Jun 23 22:40:07.402440 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:40:07.402440 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:40:07.402440 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:40:07.402440 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:40:07.402440 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:40:07.402440 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:40:07.402440 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:40:07.402440 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:40:07.402440 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd22650e-6851-4f81-a8d4-e4c7ade26c73 could not be found. Jun 23 22:40:07.402440 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:40:07.403728 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-de480a21-65f5-49c9-871d-b40bdf86fc03 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Returning 404 to user: Instance cd22650e-6851-4f81-a8d4-e4c7ade26c73 could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:40:07.403728 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-de480a21-65f5-49c9-871d-b40bdf86fc03 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73" status: 404 len: 111 microversion: 2.1 time: 0.038234 Jun 23 22:40:07.403728 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 222/469] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:07 2022] GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:40:07.409779 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-3a25e979-0be2-4346-a901-d41e8f18293e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '.version_select at 0x7fb7197a60d0>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:07.430084 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-3a25e979-0be2-4346-a901-d41e8f18293e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1129086786" status: 202 len: 0 microversion: 2.1 time: 0.024626 Jun 23 22:40:07.430729 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 248/470] 10.222.0.43 () {58 vars in 1220 bytes} [Thu Jun 23 22:40:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1129086786 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:40:07.475721 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d5a99b0b-f87b-4d6f-8212-3a67dbbc6e6c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:07.476762 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-d5a99b0b-f87b-4d6f-8212-3a67dbbc6e6c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:07.483935 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d5a99b0b-f87b-4d6f-8212-3a67dbbc6e6c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:07.484356 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d5a99b0b-f87b-4d6f-8212-3a67dbbc6e6c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:07.485385 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d5a99b0b-f87b-4d6f-8212-3a67dbbc6e6c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:07.486211 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d5a99b0b-f87b-4d6f-8212-3a67dbbc6e6c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:07.673771 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d5a99b0b-f87b-4d6f-8212-3a67dbbc6e6c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:07.683881 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d5a99b0b-f87b-4d6f-8212-3a67dbbc6e6c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1735 microversion: 2.1 time: 0.212556 Jun 23 22:40:07.685181 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 223/471] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:07 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1735 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:40:08.127132 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-19d63fe7-3c1b-46b9-b108-b34cd525bdf7 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Action: 'create', calling method: .version_select at 0x7fb7197ec4c0>, body: {"keypair": {"name": "tempest-keypair-1939627023", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbePcdS2ItLzSQ9U1q0/TAPVv6HbQdU4yX0CcRlWqEcpu/AtUAfW8ktonG2zgcnfNVL9f7wIk818JVIcJQLMCvMUcuRIkcTCvUVA02cEHptXWU/Cj9NWHkacR8t9Ch0cw=="}} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:40:08.141894 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-19d63fe7-3c1b-46b9-b108-b34cd525bdf7 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Getting quotas for project 2735e40fe2564a6d8a5cdc7c32b0b869. Resources: {'key_pairs'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:40:08.146579 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-19d63fe7-3c1b-46b9-b108-b34cd525bdf7 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Getting quotas for user 03486c7630314392b85271455d12aba2 and project 2735e40fe2564a6d8a5cdc7c32b0b869. Resources: {'key_pairs'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:40:08.168519 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-19d63fe7-3c1b-46b9-b108-b34cd525bdf7 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045368 Jun 23 22:40:08.169116 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 249/472] 10.222.0.43 () {60 vars in 1158 bytes} [Thu Jun 23 22:40:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:40:08.701833 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-4308f8e8-c6b3-49d4-ab7c-7bf414def050 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:08.702447 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-4308f8e8-c6b3-49d4-ab7c-7bf414def050 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:08.709575 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4308f8e8-c6b3-49d4-ab7c-7bf414def050 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:08.710017 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4308f8e8-c6b3-49d4-ab7c-7bf414def050 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:08.710774 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4308f8e8-c6b3-49d4-ab7c-7bf414def050 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:08.711226 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4308f8e8-c6b3-49d4-ab7c-7bf414def050 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:08.912851 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4308f8e8-c6b3-49d4-ab7c-7bf414def050 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:08.920850 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-4308f8e8-c6b3-49d4-ab7c-7bf414def050 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1735 microversion: 2.1 time: 0.222884 Jun 23 22:40:08.921423 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 224/473] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:08 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1735 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:40:09.512448 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-c2c3c75c-5a6f-4064-95b7-a59de341b365 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-267021110", "imageRef": "ac7d441e-2ac8-49ad-9dc5-3c55bd4b4f8b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e8170354-014e-4823-a204-b43deead6b56"}], "security_groups": [{"name": "tempest-securitygroup--1793630874"}], "key_name": "tempest-keypair-1939627023", "user_data": "}} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:40:09.616206 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.network.neutron [None req-c2c3c75c-5a6f-4064-95b7-a59de341b365 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] validate_networks() for [('e8170354-014e-4823-a204-b43deead6b56', None, None, None, None, None)] {{(pid=124357) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:40:09.938744 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-4f5633fa-a3f8-40a4-80d0-558abdedafec tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:09.939381 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-4f5633fa-a3f8-40a4-80d0-558abdedafec tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:09.946071 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4f5633fa-a3f8-40a4-80d0-558abdedafec tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:09.946522 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4f5633fa-a3f8-40a4-80d0-558abdedafec tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:09.947327 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4f5633fa-a3f8-40a4-80d0-558abdedafec tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:09.947781 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4f5633fa-a3f8-40a4-80d0-558abdedafec tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:09.974217 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-c2c3c75c-5a6f-4064-95b7-a59de341b365 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Flavor limits 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:40:09.974767 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-c2c3c75c-5a6f-4064-95b7-a59de341b365 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Image limits 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:40:09.975271 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-c2c3c75c-5a6f-4064-95b7-a59de341b365 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Flavor pref 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:40:09.975678 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-c2c3c75c-5a6f-4064-95b7-a59de341b365 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Image pref 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:40:09.976085 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-c2c3c75c-5a6f-4064-95b7-a59de341b365 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:40:09.978188 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:40:09.988071 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c2c3c75c-5a6f-4064-95b7-a59de341b365 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:09.988441 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c2c3c75c-5a6f-4064-95b7-a59de341b365 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:09.989248 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c2c3c75c-5a6f-4064-95b7-a59de341b365 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:09.989680 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c2c3c75c-5a6f-4064-95b7-a59de341b365 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:10.008462 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-c2c3c75c-5a6f-4064-95b7-a59de341b365 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Getting quotas for project 2735e40fe2564a6d8a5cdc7c32b0b869. Resources: {'instances', 'cores', 'ram'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:40:10.012510 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-c2c3c75c-5a6f-4064-95b7-a59de341b365 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Getting quotas for user 03486c7630314392b85271455d12aba2 and project 2735e40fe2564a6d8a5cdc7c32b0b869. Resources: {'instances', 'cores', 'ram'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:40:10.024893 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-c2c3c75c-5a6f-4064-95b7-a59de341b365 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Going to run 1 instances... {{(pid=124357) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:40:10.027286 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-c2c3c75c-5a6f-4064-95b7-a59de341b365 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: e085b10f-a993-4e81-963d-0006a6431b67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ac7d441e-2ac8-49ad-9dc5-3c55bd4b4f8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:40:10.075574 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-c2c3c75c-5a6f-4064-95b7-a59de341b365 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.567900 Jun 23 22:40:10.081793 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 250/474] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Jun 23 22:40:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 22:40:10.081969 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4f5633fa-a3f8-40a4-80d0-558abdedafec tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:10.087580 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-628d5a78-8baf-4491-8fe7-3d8c7801c358 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:10.087906 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-4f5633fa-a3f8-40a4-80d0-558abdedafec tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1735 microversion: 2.1 time: 0.152795 Jun 23 22:40:10.088219 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-628d5a78-8baf-4491-8fe7-3d8c7801c358 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: e085b10f-a993-4e81-963d-0006a6431b67] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:10.088686 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 225/475] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:09 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:40:10.153882 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-628d5a78-8baf-4491-8fe7-3d8c7801c358 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:10.161375 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-628d5a78-8baf-4491-8fe7-3d8c7801c358 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67" status: 200 len: 1241 microversion: 2.1 time: 0.077729 Jun 23 22:40:10.161960 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 251/476] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:10 2022] GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67 => generated 1241 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:40:11.105539 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-126fdd3f-2688-4ce3-a788-20cc4cf62715 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:11.106153 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-126fdd3f-2688-4ce3-a788-20cc4cf62715 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:11.113539 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-126fdd3f-2688-4ce3-a788-20cc4cf62715 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:11.113977 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-126fdd3f-2688-4ce3-a788-20cc4cf62715 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:11.114731 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-126fdd3f-2688-4ce3-a788-20cc4cf62715 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:11.115183 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-126fdd3f-2688-4ce3-a788-20cc4cf62715 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:11.177889 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-33b85037-2864-4558-8ff7-6cf2d0079188 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:11.178495 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-33b85037-2864-4558-8ff7-6cf2d0079188 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: e085b10f-a993-4e81-963d-0006a6431b67] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:11.185276 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-33b85037-2864-4558-8ff7-6cf2d0079188 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:11.185710 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-33b85037-2864-4558-8ff7-6cf2d0079188 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:11.186461 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-33b85037-2864-4558-8ff7-6cf2d0079188 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:11.186886 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-33b85037-2864-4558-8ff7-6cf2d0079188 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:11.254244 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-33b85037-2864-4558-8ff7-6cf2d0079188 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:11.263501 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-33b85037-2864-4558-8ff7-6cf2d0079188 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67" status: 200 len: 1293 microversion: 2.1 time: 0.089466 Jun 23 22:40:11.264075 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 252/477] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:11 2022] GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67 => generated 1293 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:40:11.278519 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-126fdd3f-2688-4ce3-a788-20cc4cf62715 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:11.288855 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-126fdd3f-2688-4ce3-a788-20cc4cf62715 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1735 microversion: 2.1 time: 0.187040 Jun 23 22:40:11.290395 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 226/478] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:11 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1735 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:40:12.281116 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-7a306e38-5cc8-43e2-a893-a750551dbb8a tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:12.281734 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-7a306e38-5cc8-43e2-a893-a750551dbb8a tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: e085b10f-a993-4e81-963d-0006a6431b67] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:12.289446 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7a306e38-5cc8-43e2-a893-a750551dbb8a tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:12.289903 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7a306e38-5cc8-43e2-a893-a750551dbb8a tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:12.290680 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7a306e38-5cc8-43e2-a893-a750551dbb8a tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:12.291153 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7a306e38-5cc8-43e2-a893-a750551dbb8a tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:12.306685 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-ff7ced2e-1042-4552-aa0b-c53e2eeb28bb tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:12.308061 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-ff7ced2e-1042-4552-aa0b-c53e2eeb28bb tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:12.316045 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ff7ced2e-1042-4552-aa0b-c53e2eeb28bb tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:12.316559 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ff7ced2e-1042-4552-aa0b-c53e2eeb28bb tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:12.317401 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ff7ced2e-1042-4552-aa0b-c53e2eeb28bb tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:12.318057 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ff7ced2e-1042-4552-aa0b-c53e2eeb28bb tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:12.608680 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ff7ced2e-1042-4552-aa0b-c53e2eeb28bb tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:12.616362 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-7a306e38-5cc8-43e2-a893-a750551dbb8a tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:12.616873 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-ff7ced2e-1042-4552-aa0b-c53e2eeb28bb tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1735 microversion: 2.1 time: 0.313878 Jun 23 22:40:12.617441 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 227/479] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:12 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1735 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:40:12.623977 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-7a306e38-5cc8-43e2-a893-a750551dbb8a tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67" status: 200 len: 1367 microversion: 2.1 time: 0.346704 Jun 23 22:40:12.624539 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 253/480] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:12 2022] GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67 => generated 1367 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:40:12.956138 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-2682b21f-c66e-45aa-a491-e296ba13d138 req-4e09aa5a-a86d-44c5-a392-bad4e4b86478 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e085b10f-a993-4e81-963d-0006a6431b67", "tag": "249824e0-dfdc-4f82-b94a-8d07832fb74e"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:40:12.965887 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-2682b21f-c66e-45aa-a491-e296ba13d138 req-4e09aa5a-a86d-44c5-a392-bad4e4b86478 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:12.967342 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-2682b21f-c66e-45aa-a491-e296ba13d138 req-4e09aa5a-a86d-44c5-a392-bad4e4b86478 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:12.984629 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-2682b21f-c66e-45aa-a491-e296ba13d138 req-4e09aa5a-a86d-44c5-a392-bad4e4b86478 service nova] Creating event network-changed:249824e0-dfdc-4f82-b94a-8d07832fb74e for instance e085b10f-a993-4e81-963d-0006a6431b67 on hv-cinder-84617 Jun 23 22:40:12.991623 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-2682b21f-c66e-45aa-a491-e296ba13d138 req-4e09aa5a-a86d-44c5-a392-bad4e4b86478 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038444 Jun 23 22:40:12.992383 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 228/481] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:40:13.633621 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-c205ae5e-fc10-4ea4-9b53-9863928b9607 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:13.634143 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-c205ae5e-fc10-4ea4-9b53-9863928b9607 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:13.640679 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c205ae5e-fc10-4ea4-9b53-9863928b9607 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:13.641120 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c205ae5e-fc10-4ea4-9b53-9863928b9607 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:13.641789 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-64ac92f0-bb52-4cca-a624-d857345d870f tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:13.642233 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c205ae5e-fc10-4ea4-9b53-9863928b9607 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:13.642338 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c205ae5e-fc10-4ea4-9b53-9863928b9607 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:13.644332 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-64ac92f0-bb52-4cca-a624-d857345d870f tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: e085b10f-a993-4e81-963d-0006a6431b67] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:13.650855 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-64ac92f0-bb52-4cca-a624-d857345d870f tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:13.651349 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-64ac92f0-bb52-4cca-a624-d857345d870f tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:13.652108 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-64ac92f0-bb52-4cca-a624-d857345d870f tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:13.652533 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-64ac92f0-bb52-4cca-a624-d857345d870f tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:14.077921 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-c205ae5e-fc10-4ea4-9b53-9863928b9607 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:14.082938 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-64ac92f0-bb52-4cca-a624-d857345d870f tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:14.086596 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-c205ae5e-fc10-4ea4-9b53-9863928b9607 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1735 microversion: 2.1 time: 0.456823 Jun 23 22:40:14.087189 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 254/482] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:13 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1735 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:40:14.090394 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-64ac92f0-bb52-4cca-a624-d857345d870f tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67" status: 200 len: 1367 microversion: 2.1 time: 0.452715 Jun 23 22:40:14.090976 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 229/483] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:13 2022] GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67 => generated 1367 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:40:15.104654 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-4b92a694-7e69-402e-b4ad-1dd789e1f9e8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:15.105442 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-4b92a694-7e69-402e-b4ad-1dd789e1f9e8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:15.106084 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f89ae5cc-0489-4fb6-a621-b3cc6e7c5052 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:15.107211 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-f89ae5cc-0489-4fb6-a621-b3cc6e7c5052 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: e085b10f-a993-4e81-963d-0006a6431b67] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:15.111671 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-4b92a694-7e69-402e-b4ad-1dd789e1f9e8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:15.112183 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-4b92a694-7e69-402e-b4ad-1dd789e1f9e8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:15.113007 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-4b92a694-7e69-402e-b4ad-1dd789e1f9e8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:15.113503 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-4b92a694-7e69-402e-b4ad-1dd789e1f9e8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:15.114130 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f89ae5cc-0489-4fb6-a621-b3cc6e7c5052 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:15.114767 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f89ae5cc-0489-4fb6-a621-b3cc6e7c5052 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:15.115556 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f89ae5cc-0489-4fb6-a621-b3cc6e7c5052 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:15.116140 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f89ae5cc-0489-4fb6-a621-b3cc6e7c5052 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:15.388978 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-4b92a694-7e69-402e-b4ad-1dd789e1f9e8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:15.392698 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f89ae5cc-0489-4fb6-a621-b3cc6e7c5052 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:15.397490 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-4b92a694-7e69-402e-b4ad-1dd789e1f9e8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1735 microversion: 2.1 time: 0.297790 Jun 23 22:40:15.398057 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 255/484] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:15 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1735 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:40:15.401163 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f89ae5cc-0489-4fb6-a621-b3cc6e7c5052 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67" status: 200 len: 1367 microversion: 2.1 time: 0.298795 Jun 23 22:40:15.401884 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 230/485] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:15 2022] GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67 => generated 1367 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:40:16.415710 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-b8163523-0656-4821-ad47-65bcbaac7049 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:16.416244 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-b8163523-0656-4821-ad47-65bcbaac7049 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:16.418826 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f3ab01fc-a8b8-4ce2-8e4d-261d604104f5 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:16.419480 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-f3ab01fc-a8b8-4ce2-8e4d-261d604104f5 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: e085b10f-a993-4e81-963d-0006a6431b67] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:16.422779 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-b8163523-0656-4821-ad47-65bcbaac7049 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:16.423265 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-b8163523-0656-4821-ad47-65bcbaac7049 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:16.424018 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-b8163523-0656-4821-ad47-65bcbaac7049 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:16.424825 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-b8163523-0656-4821-ad47-65bcbaac7049 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:16.426013 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f3ab01fc-a8b8-4ce2-8e4d-261d604104f5 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:16.426455 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f3ab01fc-a8b8-4ce2-8e4d-261d604104f5 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:16.427246 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f3ab01fc-a8b8-4ce2-8e4d-261d604104f5 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:16.427674 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f3ab01fc-a8b8-4ce2-8e4d-261d604104f5 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:16.616959 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-b8163523-0656-4821-ad47-65bcbaac7049 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:16.620837 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f3ab01fc-a8b8-4ce2-8e4d-261d604104f5 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:16.625057 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-b8163523-0656-4821-ad47-65bcbaac7049 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1735 microversion: 2.1 time: 0.213473 Jun 23 22:40:16.625662 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 256/486] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:16 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1735 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:40:16.628928 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f3ab01fc-a8b8-4ce2-8e4d-261d604104f5 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67" status: 200 len: 1367 microversion: 2.1 time: 0.214481 Jun 23 22:40:16.629486 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 231/487] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:16 2022] GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:40:17.642312 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-d1576261-38bf-4cb9-8648-e96f8027094c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:17.642978 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-d1576261-38bf-4cb9-8648-e96f8027094c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:17.644417 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-efd22fe6-fc12-4603-815a-0865c52af875 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:17.645029 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-efd22fe6-fc12-4603-815a-0865c52af875 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: e085b10f-a993-4e81-963d-0006a6431b67] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:17.649407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d1576261-38bf-4cb9-8648-e96f8027094c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:17.649822 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d1576261-38bf-4cb9-8648-e96f8027094c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:17.650576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d1576261-38bf-4cb9-8648-e96f8027094c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:17.651027 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d1576261-38bf-4cb9-8648-e96f8027094c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:17.651607 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-efd22fe6-fc12-4603-815a-0865c52af875 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:17.652050 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-efd22fe6-fc12-4603-815a-0865c52af875 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:17.652806 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-efd22fe6-fc12-4603-815a-0865c52af875 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:17.653236 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-efd22fe6-fc12-4603-815a-0865c52af875 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:17.839982 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-efd22fe6-fc12-4603-815a-0865c52af875 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:17.849034 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-efd22fe6-fc12-4603-815a-0865c52af875 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67" status: 200 len: 1367 microversion: 2.1 time: 0.208476 Jun 23 22:40:17.849966 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 232/488] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:17 2022] GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67 => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:40:17.856803 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-d1576261-38bf-4cb9-8648-e96f8027094c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:17.865899 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-d1576261-38bf-4cb9-8648-e96f8027094c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1735 microversion: 2.1 time: 0.227390 Jun 23 22:40:17.866471 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 257/489] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:17 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1735 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:40:18.865918 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-3b07e4cf-68ee-4738-bc95-e52871ac0d77 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:18.866513 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-3b07e4cf-68ee-4738-bc95-e52871ac0d77 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: e085b10f-a993-4e81-963d-0006a6431b67] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:18.872990 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3b07e4cf-68ee-4738-bc95-e52871ac0d77 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:18.873434 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3b07e4cf-68ee-4738-bc95-e52871ac0d77 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:18.874191 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3b07e4cf-68ee-4738-bc95-e52871ac0d77 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:18.874622 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3b07e4cf-68ee-4738-bc95-e52871ac0d77 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:18.883887 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-3d896761-841b-4c86-8026-d131ea448fed tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:18.884503 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-3d896761-841b-4c86-8026-d131ea448fed tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:18.890879 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3d896761-841b-4c86-8026-d131ea448fed tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:18.891356 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3d896761-841b-4c86-8026-d131ea448fed tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:18.892121 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3d896761-841b-4c86-8026-d131ea448fed tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:18.892554 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3d896761-841b-4c86-8026-d131ea448fed tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:19.074970 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-3b07e4cf-68ee-4738-bc95-e52871ac0d77 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:19.083558 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-3b07e4cf-68ee-4738-bc95-e52871ac0d77 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67" status: 200 len: 1367 microversion: 2.1 time: 0.221565 Jun 23 22:40:19.084135 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 233/490] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:18 2022] GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67 => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:40:19.084434 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-3d896761-841b-4c86-8026-d131ea448fed tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:19.094824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-3d896761-841b-4c86-8026-d131ea448fed tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1735 microversion: 2.1 time: 0.214685 Jun 23 22:40:19.095485 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 258/491] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:18 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1735 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:40:19.237655 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-6bd98bda-9b6c-4e39-8e01-d37dbcb91ef9 req-fc28687c-1f6a-4dd3-b4b5-c43000917e9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e085b10f-a993-4e81-963d-0006a6431b67", "name": "network-vif-plugged", "status": "completed", "tag": "249824e0-dfdc-4f82-b94a-8d07832fb74e"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:40:19.246247 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-6bd98bda-9b6c-4e39-8e01-d37dbcb91ef9 req-fc28687c-1f6a-4dd3-b4b5-c43000917e9e service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:19.246699 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-6bd98bda-9b6c-4e39-8e01-d37dbcb91ef9 req-fc28687c-1f6a-4dd3-b4b5-c43000917e9e service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:19.258558 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-6bd98bda-9b6c-4e39-8e01-d37dbcb91ef9 req-fc28687c-1f6a-4dd3-b4b5-c43000917e9e service nova] Creating event network-vif-plugged:249824e0-dfdc-4f82-b94a-8d07832fb74e for instance e085b10f-a993-4e81-963d-0006a6431b67 on hv-cinder-84617 Jun 23 22:40:19.263382 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-6bd98bda-9b6c-4e39-8e01-d37dbcb91ef9 req-fc28687c-1f6a-4dd3-b4b5-c43000917e9e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029777 Jun 23 22:40:19.264123 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 234/492] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:40:20.100071 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-54026020-aa4c-406b-bd29-88e1faadd06e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:20.100686 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-54026020-aa4c-406b-bd29-88e1faadd06e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: e085b10f-a993-4e81-963d-0006a6431b67] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:20.102974 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell0:SELECT=2 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:40:20.108448 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-54026020-aa4c-406b-bd29-88e1faadd06e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:20.108895 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-54026020-aa4c-406b-bd29-88e1faadd06e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:20.109655 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-54026020-aa4c-406b-bd29-88e1faadd06e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:20.110096 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-54026020-aa4c-406b-bd29-88e1faadd06e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:20.112605 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-ed55b765-e9ae-44ff-871b-cfcdd9416114 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:20.113322 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-ed55b765-e9ae-44ff-871b-cfcdd9416114 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:20.120288 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ed55b765-e9ae-44ff-871b-cfcdd9416114 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:20.120721 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ed55b765-e9ae-44ff-871b-cfcdd9416114 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:20.121511 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ed55b765-e9ae-44ff-871b-cfcdd9416114 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:20.122023 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ed55b765-e9ae-44ff-871b-cfcdd9416114 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:20.158689 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell0:SELECT=12 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:40:20.308776 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-54026020-aa4c-406b-bd29-88e1faadd06e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:20.315616 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ed55b765-e9ae-44ff-871b-cfcdd9416114 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:20.316207 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-54026020-aa4c-406b-bd29-88e1faadd06e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67" status: 200 len: 1367 microversion: 2.1 time: 0.220652 Jun 23 22:40:20.317355 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 259/493] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:20 2022] GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67 => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:40:20.324680 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-ed55b765-e9ae-44ff-871b-cfcdd9416114 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1735 microversion: 2.1 time: 0.216702 Jun 23 22:40:20.325238 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 235/494] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:20 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1735 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:40:21.334588 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-7ed6389b-8632-417e-85d8-74a7b81d3a49 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:21.335228 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-7ed6389b-8632-417e-85d8-74a7b81d3a49 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: e085b10f-a993-4e81-963d-0006a6431b67] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:21.341686 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7ed6389b-8632-417e-85d8-74a7b81d3a49 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:21.341961 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b68951ae-7634-4614-9d72-ce78933ef45a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:21.342392 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7ed6389b-8632-417e-85d8-74a7b81d3a49 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:21.342572 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-b68951ae-7634-4614-9d72-ce78933ef45a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:21.342866 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7ed6389b-8632-417e-85d8-74a7b81d3a49 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:21.343323 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7ed6389b-8632-417e-85d8-74a7b81d3a49 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:21.350461 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b68951ae-7634-4614-9d72-ce78933ef45a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:21.350959 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b68951ae-7634-4614-9d72-ce78933ef45a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:21.351699 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b68951ae-7634-4614-9d72-ce78933ef45a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:21.352133 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b68951ae-7634-4614-9d72-ce78933ef45a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:21.543367 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b68951ae-7634-4614-9d72-ce78933ef45a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:21.546038 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-7ed6389b-8632-417e-85d8-74a7b81d3a49 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:21.551421 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-b68951ae-7634-4614-9d72-ce78933ef45a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1735 microversion: 2.1 time: 0.213040 Jun 23 22:40:21.552074 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 236/495] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:21 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1735 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:40:21.553664 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-7ed6389b-8632-417e-85d8-74a7b81d3a49 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67" status: 200 len: 1367 microversion: 2.1 time: 0.223566 Jun 23 22:40:21.554225 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 260/496] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:21 2022] GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:40:22.569376 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-ea26fc75-bb1a-4d3f-80fd-4711f338495a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:22.569990 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-ea26fc75-bb1a-4d3f-80fd-4711f338495a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:22.570348 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-1358dd54-c928-4b66-a51c-33322ee15652 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:22.571052 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-1358dd54-c928-4b66-a51c-33322ee15652 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: e085b10f-a993-4e81-963d-0006a6431b67] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:22.576774 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ea26fc75-bb1a-4d3f-80fd-4711f338495a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:22.577220 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ea26fc75-bb1a-4d3f-80fd-4711f338495a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:22.577650 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1358dd54-c928-4b66-a51c-33322ee15652 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:22.577993 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ea26fc75-bb1a-4d3f-80fd-4711f338495a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:22.578197 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1358dd54-c928-4b66-a51c-33322ee15652 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:22.578421 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ea26fc75-bb1a-4d3f-80fd-4711f338495a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:22.578826 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1358dd54-c928-4b66-a51c-33322ee15652 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:22.579289 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1358dd54-c928-4b66-a51c-33322ee15652 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:22.585886 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=100 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:40:22.776963 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-1358dd54-c928-4b66-a51c-33322ee15652 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:22.780674 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ea26fc75-bb1a-4d3f-80fd-4711f338495a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:22.784541 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-1358dd54-c928-4b66-a51c-33322ee15652 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67" status: 200 len: 1557 microversion: 2.1 time: 0.219070 Jun 23 22:40:22.785315 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 261/497] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:22 2022] GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67 => generated 1557 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:40:22.789568 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-ea26fc75-bb1a-4d3f-80fd-4711f338495a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1735 microversion: 2.1 time: 0.225053 Jun 23 22:40:22.790131 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 237/498] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:22 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1735 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:40:22.801836 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-70ba6e96-0e99-4983-9a5d-20dc92184ef2 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:22.802434 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-70ba6e96-0e99-4983-9a5d-20dc92184ef2 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: e085b10f-a993-4e81-963d-0006a6431b67] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:22.808416 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-70ba6e96-0e99-4983-9a5d-20dc92184ef2 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:22.808874 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-70ba6e96-0e99-4983-9a5d-20dc92184ef2 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:22.809618 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-70ba6e96-0e99-4983-9a5d-20dc92184ef2 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:22.810051 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-70ba6e96-0e99-4983-9a5d-20dc92184ef2 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:22.885223 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-70ba6e96-0e99-4983-9a5d-20dc92184ef2 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087701 Jun 23 22:40:22.885857 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 262/499] 10.222.0.43 () {58 vars in 1274 bytes} [Thu Jun 23 22:40:22 2022] GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:40:23.780834 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-b498a77e-3e4f-40a9-a6b2-761c82a67096 req-2bc92ef7-4009-4d9e-b985-586b1110a97a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e085b10f-a993-4e81-963d-0006a6431b67", "tag": "249824e0-dfdc-4f82-b94a-8d07832fb74e"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:40:23.790425 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-b498a77e-3e4f-40a9-a6b2-761c82a67096 req-2bc92ef7-4009-4d9e-b985-586b1110a97a service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:23.790947 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-b498a77e-3e4f-40a9-a6b2-761c82a67096 req-2bc92ef7-4009-4d9e-b985-586b1110a97a service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:23.802247 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-b498a77e-3e4f-40a9-a6b2-761c82a67096 req-2bc92ef7-4009-4d9e-b985-586b1110a97a service nova] Creating event network-changed:249824e0-dfdc-4f82-b94a-8d07832fb74e for instance e085b10f-a993-4e81-963d-0006a6431b67 on hv-cinder-84617 Jun 23 22:40:23.807526 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-b498a77e-3e4f-40a9-a6b2-761c82a67096 req-2bc92ef7-4009-4d9e-b985-586b1110a97a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030238 Jun 23 22:40:23.808268 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 238/500] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:40:23.808859 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-3360e3e8-dc6f-4a52-9731-eeba04af0804 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:23.809466 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-3360e3e8-dc6f-4a52-9731-eeba04af0804 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:23.815640 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3360e3e8-dc6f-4a52-9731-eeba04af0804 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:23.816087 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3360e3e8-dc6f-4a52-9731-eeba04af0804 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:23.817052 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3360e3e8-dc6f-4a52-9731-eeba04af0804 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:23.817473 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3360e3e8-dc6f-4a52-9731-eeba04af0804 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:23.944319 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-3360e3e8-dc6f-4a52-9731-eeba04af0804 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:23.952343 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-3360e3e8-dc6f-4a52-9731-eeba04af0804 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1735 microversion: 2.1 time: 0.148760 Jun 23 22:40:23.952930 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 263/501] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:23 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:40:24.970498 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-1cbc68c3-8225-4deb-9d10-210d54c41d47 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:24.971223 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-1cbc68c3-8225-4deb-9d10-210d54c41d47 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:24.978195 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1cbc68c3-8225-4deb-9d10-210d54c41d47 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:24.978635 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1cbc68c3-8225-4deb-9d10-210d54c41d47 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:24.979441 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1cbc68c3-8225-4deb-9d10-210d54c41d47 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:24.979865 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1cbc68c3-8225-4deb-9d10-210d54c41d47 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:25.180738 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-1cbc68c3-8225-4deb-9d10-210d54c41d47 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:25.188728 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-1cbc68c3-8225-4deb-9d10-210d54c41d47 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1735 microversion: 2.1 time: 0.222892 Jun 23 22:40:25.189322 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 239/502] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:24 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1735 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:40:26.205965 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-932878fb-f295-4205-86fe-073fc324b98c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:26.206580 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-932878fb-f295-4205-86fe-073fc324b98c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:26.213299 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-932878fb-f295-4205-86fe-073fc324b98c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:26.213741 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-932878fb-f295-4205-86fe-073fc324b98c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:26.214492 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-932878fb-f295-4205-86fe-073fc324b98c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:26.214945 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-932878fb-f295-4205-86fe-073fc324b98c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:26.343475 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-932878fb-f295-4205-86fe-073fc324b98c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:26.351508 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-932878fb-f295-4205-86fe-073fc324b98c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1735 microversion: 2.1 time: 0.149424 Jun 23 22:40:26.352062 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 264/503] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:26 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:40:27.368530 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a6242760-2786-406e-9fef-165ec7c52d6e tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:27.369164 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-a6242760-2786-406e-9fef-165ec7c52d6e tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:27.375445 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a6242760-2786-406e-9fef-165ec7c52d6e tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:27.376043 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a6242760-2786-406e-9fef-165ec7c52d6e tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:27.376832 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a6242760-2786-406e-9fef-165ec7c52d6e tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:27.377260 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a6242760-2786-406e-9fef-165ec7c52d6e tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:27.508755 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-a6242760-2786-406e-9fef-165ec7c52d6e tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:27.517032 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-a6242760-2786-406e-9fef-165ec7c52d6e tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1715 microversion: 2.1 time: 0.152356 Jun 23 22:40:27.517599 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 240/504] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:27 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1715 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:40:27.620839 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-01e7f681-4d61-49d0-b35b-088716c87ee9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:27.621349 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-01e7f681-4d61-49d0-b35b-088716c87ee9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:27.631998 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-01e7f681-4d61-49d0-b35b-088716c87ee9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:27.632445 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-01e7f681-4d61-49d0-b35b-088716c87ee9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:27.633238 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-01e7f681-4d61-49d0-b35b-088716c87ee9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:27.633669 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-01e7f681-4d61-49d0-b35b-088716c87ee9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:27.756663 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.wsgi [None req-01e7f681-4d61-49d0-b35b-088716c87ee9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] HTTP exception thrown: Cannot 'detach_volume' instance 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b while it is in vm_state rescued Jun 23 22:40:27.758243 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-01e7f681-4d61-49d0-b35b-088716c87ee9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Request method failure captured: Jun 23 22:40:27.758243 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: request: DELETE /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b/os-volume_attachments/9659d8f6-7895-409e-a775-6d2be766f904 HTTP/1.1 Jun 23 22:40:27.758243 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept: application/json Jun 23 22:40:27.758243 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept-Encoding: identity Jun 23 22:40:27.758243 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Connection: close Jun 23 22:40:27.758243 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Length: 0 Jun 23 22:40:27.758243 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Type: application/json Jun 23 22:40:27.758243 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Host: 10.222.0.43 Jun 23 22:40:27.758243 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Openstack-System-Scope: None Jun 23 22:40:27.758243 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: User-Agent: python-urllib3/1.26.9 Jun 23 22:40:27.758243 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Auth-Token: gAAAAABitOraLpi8Pvpi8Qc1Y4M-Pla8fum-8INT6fklVezA6HYJEy-_7LboWQXaqmKodYFNcJuBs2lqdl0aMvfex_YkVFYW6g3zGPxaMIBdBYAGSe9Z9h-akU9iV1MHzsT9eii0Id3pUsBpLUHlU69nBSDw0uRkdeq0OpdeT6mYb1v54X9To2I Jun 23 22:40:27.758243 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Id: None Jun 23 22:40:27.758243 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Name: None Jun 23 22:40:27.758243 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Identity-Status: Confirmed Jun 23 22:40:27.758243 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Is-Admin-Project: True Jun 23 22:40:27.758243 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Id: default Jun 23 22:40:27.758243 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Name: Default Jun 23 22:40:27.758243 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Id: 192d1c8d15ce462dbf10fc3b519ab253 Jun 23 22:40:27.758243 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-675175554 Jun 23 22:40:27.758243 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Role: reader,member Jun 23 22:40:27.758243 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Roles: reader,member Jun 23 22:40:27.759923 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/192d1c8d15ce462dbf10fc3b519ab253"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/192d1c8d15ce462dbf10fc3b519ab253"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_192d1c8d15ce462dbf10fc3b519ab253", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/192d1c8d15ce462dbf10fc3b519ab253"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:40:27.759923 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant: tempest-ServerRescueNegativeTestJSON-675175554 Jun 23 22:40:27.759923 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Id: 192d1c8d15ce462dbf10fc3b519ab253 Jun 23 22:40:27.759923 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-675175554 Jun 23 22:40:27.759923 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User: tempest-ServerRescueNegativeTestJSON-675175554-project Jun 23 22:40:27.759923 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Id: default Jun 23 22:40:27.759923 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Name: Default Jun 23 22:40:27.759923 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Id: dc246e144afc46698000f7f53ef6489e Jun 23 22:40:27.759923 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Name: tempest-ServerRescueNegativeTestJSON-675175554-project Jun 23 22:40:27.759923 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: method: > Jun 23 22:40:27.759923 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: exception: Cannot 'detach_volume' instance 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b while it is in vm_state rescued Jun 23 22:40:27.760745 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: action_args: {'server_id': '05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b', 'id': '9659d8f6-7895-409e-a775-6d2be766f904'} Jun 23 22:40:27.760745 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:40:27.760745 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:40:27.760745 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 23 22:40:27.760745 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 23 22:40:27.760745 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 22:40:27.760745 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 22:40:27.760745 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 23 22:40:27.760745 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 23 22:40:27.760745 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 23 22:40:27.760745 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:40:27.760745 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:40:27.760745 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:40:27.760745 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:40:27.760745 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:40:27.760745 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:40:27.760745 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:40:27.760745 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:40:27.760745 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:40:27.760745 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:40:27.762237 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 23 22:40:27.762237 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 23 22:40:27.762237 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 23 22:40:27.762237 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 23 22:40:27.762237 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b while it is in vm_state rescued Jun 23 22:40:27.762237 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:40:27.762237 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:40:27.762237 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:40:27.762237 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:40:27.762237 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:40:27.762237 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:40:27.762237 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:40:27.762237 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:40:27.762237 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b while it is in vm_state rescued Jun 23 22:40:27.762237 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:40:27.762237 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-01e7f681-4d61-49d0-b35b-088716c87ee9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Returning 409 to user: Cannot 'detach_volume' instance 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b while it is in vm_state rescued {{(pid=124357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:40:27.763611 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-01e7f681-4d61-49d0-b35b-088716c87ee9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "DELETE /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b/os-volume_attachments/9659d8f6-7895-409e-a775-6d2be766f904" status: 409 len: 152 microversion: 2.1 time: 0.142911 Jun 23 22:40:27.763611 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 265/505] 10.222.0.43 () {58 vars in 1415 bytes} [Thu Jun 23 22:40:27 2022] DELETE /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b/os-volume_attachments/9659d8f6-7895-409e-a775-6d2be766f904 => generated 152 bytes in 144 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 23 22:40:27.768537 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-cd964020-55eb-42d0-adaa-b4eff6a3d441 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:40:27.769056 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-cd964020-55eb-42d0-adaa-b4eff6a3d441 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:27.774945 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cd964020-55eb-42d0-adaa-b4eff6a3d441 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:27.775385 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cd964020-55eb-42d0-adaa-b4eff6a3d441 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:27.776131 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cd964020-55eb-42d0-adaa-b4eff6a3d441 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:27.776555 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cd964020-55eb-42d0-adaa-b4eff6a3d441 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:27.840283 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-cd964020-55eb-42d0-adaa-b4eff6a3d441 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "POST /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b/action" status: 202 len: 0 microversion: 2.1 time: 0.075466 Jun 23 22:40:27.840882 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 241/506] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Jun 23 22:40:27 2022] POST /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:40:27.849040 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-a9dc8818-b8cb-4335-8920-37497465a6c7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:27.849651 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-a9dc8818-b8cb-4335-8920-37497465a6c7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:27.856271 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a9dc8818-b8cb-4335-8920-37497465a6c7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:27.856727 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a9dc8818-b8cb-4335-8920-37497465a6c7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:27.857483 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a9dc8818-b8cb-4335-8920-37497465a6c7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:27.857914 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a9dc8818-b8cb-4335-8920-37497465a6c7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:28.071226 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-a9dc8818-b8cb-4335-8920-37497465a6c7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:28.079157 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-a9dc8818-b8cb-4335-8920-37497465a6c7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1723 microversion: 2.1 time: 0.233908 Jun 23 22:40:28.079919 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 266/507] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:27 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:40:29.097002 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-53be9d0c-367f-4094-932b-dbaaec4423c0 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:29.097732 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-53be9d0c-367f-4094-932b-dbaaec4423c0 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:29.104423 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-53be9d0c-367f-4094-932b-dbaaec4423c0 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:29.104871 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-53be9d0c-367f-4094-932b-dbaaec4423c0 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:29.105715 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-53be9d0c-367f-4094-932b-dbaaec4423c0 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:29.106153 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-53be9d0c-367f-4094-932b-dbaaec4423c0 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:29.235341 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-53be9d0c-367f-4094-932b-dbaaec4423c0 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:29.243320 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-53be9d0c-367f-4094-932b-dbaaec4423c0 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1723 microversion: 2.1 time: 0.150977 Jun 23 22:40:29.243882 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 242/508] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:29 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:40:30.261159 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-23054acb-a696-4a15-86f3-95e941eb00f1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:30.261765 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-23054acb-a696-4a15-86f3-95e941eb00f1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:30.268668 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-23054acb-a696-4a15-86f3-95e941eb00f1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:30.269110 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-23054acb-a696-4a15-86f3-95e941eb00f1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:30.270436 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-23054acb-a696-4a15-86f3-95e941eb00f1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:30.270866 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-23054acb-a696-4a15-86f3-95e941eb00f1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:30.400730 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-23054acb-a696-4a15-86f3-95e941eb00f1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:30.404082 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell1:SELECT=100 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:40:30.409761 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-23054acb-a696-4a15-86f3-95e941eb00f1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1723 microversion: 2.1 time: 0.152552 Jun 23 22:40:30.410356 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 267/509] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:30 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:40:31.427324 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f933fc93-bf59-46d1-8b49-f60a3d0da5fd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:31.427930 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-f933fc93-bf59-46d1-8b49-f60a3d0da5fd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:31.434426 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f933fc93-bf59-46d1-8b49-f60a3d0da5fd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:31.434869 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f933fc93-bf59-46d1-8b49-f60a3d0da5fd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:31.435655 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f933fc93-bf59-46d1-8b49-f60a3d0da5fd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:31.436084 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f933fc93-bf59-46d1-8b49-f60a3d0da5fd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:31.561817 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f933fc93-bf59-46d1-8b49-f60a3d0da5fd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:31.570007 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f933fc93-bf59-46d1-8b49-f60a3d0da5fd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1723 microversion: 2.1 time: 0.146494 Jun 23 22:40:31.570565 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 243/510] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:31 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:40:32.587996 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-69a5a219-e4aa-400c-9012-77470ae783b1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:32.588635 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-69a5a219-e4aa-400c-9012-77470ae783b1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:32.595069 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-69a5a219-e4aa-400c-9012-77470ae783b1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:32.595516 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-69a5a219-e4aa-400c-9012-77470ae783b1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:32.596273 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-69a5a219-e4aa-400c-9012-77470ae783b1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:32.596704 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-69a5a219-e4aa-400c-9012-77470ae783b1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:32.729232 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-69a5a219-e4aa-400c-9012-77470ae783b1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:32.737109 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-69a5a219-e4aa-400c-9012-77470ae783b1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1723 microversion: 2.1 time: 0.153804 Jun 23 22:40:32.737872 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 268/511] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:32 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:40:33.754507 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-2596747e-65af-4b49-bc81-5f34a19256ba tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:33.755138 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-2596747e-65af-4b49-bc81-5f34a19256ba tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:33.761624 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2596747e-65af-4b49-bc81-5f34a19256ba tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:33.762059 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2596747e-65af-4b49-bc81-5f34a19256ba tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:33.762804 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2596747e-65af-4b49-bc81-5f34a19256ba tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:33.763254 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2596747e-65af-4b49-bc81-5f34a19256ba tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:33.888871 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-2596747e-65af-4b49-bc81-5f34a19256ba tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:33.897334 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-2596747e-65af-4b49-bc81-5f34a19256ba tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1729 microversion: 2.1 time: 0.146646 Jun 23 22:40:33.897892 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 244/512] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:33 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1729 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:40:33.914706 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-8221bd1c-e10f-47b8-8a88-15e16c194a9c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:33.915259 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-8221bd1c-e10f-47b8-8a88-15e16c194a9c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:33.921640 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-8221bd1c-e10f-47b8-8a88-15e16c194a9c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:33.922089 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-8221bd1c-e10f-47b8-8a88-15e16c194a9c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:33.922851 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-8221bd1c-e10f-47b8-8a88-15e16c194a9c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:33.923313 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-8221bd1c-e10f-47b8-8a88-15e16c194a9c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:34.003428 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-8221bd1c-e10f-47b8-8a88-15e16c194a9c tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093406 Jun 23 22:40:34.004017 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 269/513] 10.222.0.43 () {58 vars in 1274 bytes} [Thu Jun 23 22:40:33 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:40:34.870350 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-035724bc-ba76-4b58-bbab-466459c75f5e req-1b5571dc-67ec-4791-bb64-9ee21632402b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b", "tag": "e4f7fec0-2950-4a5c-8ce9-2b7668c8ae34"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:40:34.879685 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-035724bc-ba76-4b58-bbab-466459c75f5e req-1b5571dc-67ec-4791-bb64-9ee21632402b service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:34.880332 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-035724bc-ba76-4b58-bbab-466459c75f5e req-1b5571dc-67ec-4791-bb64-9ee21632402b service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:34.894780 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-035724bc-ba76-4b58-bbab-466459c75f5e req-1b5571dc-67ec-4791-bb64-9ee21632402b service nova] Creating event network-changed:e4f7fec0-2950-4a5c-8ce9-2b7668c8ae34 for instance 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b on hv-cinder-84617 Jun 23 22:40:34.900062 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-035724bc-ba76-4b58-bbab-466459c75f5e req-1b5571dc-67ec-4791-bb64-9ee21632402b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034583 Jun 23 22:40:34.900777 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 245/514] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:40:36.915296 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [req-547dee2b-24ed-46fa-8c7c-6eb45c2e3475 req-8b099708-44d9-41ee-9107-1b0b099f9664 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b", "tag": "e4f7fec0-2950-4a5c-8ce9-2b7668c8ae34"}]} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:40:36.923444 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-547dee2b-24ed-46fa-8c7c-6eb45c2e3475 req-8b099708-44d9-41ee-9107-1b0b099f9664 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:36.923876 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-547dee2b-24ed-46fa-8c7c-6eb45c2e3475 req-8b099708-44d9-41ee-9107-1b0b099f9664 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:36.935834 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.compute.server_external_events [req-547dee2b-24ed-46fa-8c7c-6eb45c2e3475 req-8b099708-44d9-41ee-9107-1b0b099f9664 service nova] Creating event network-changed:e4f7fec0-2950-4a5c-8ce9-2b7668c8ae34 for instance 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b on hv-cinder-84617 Jun 23 22:40:36.940770 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [req-547dee2b-24ed-46fa-8c7c-6eb45c2e3475 req-8b099708-44d9-41ee-9107-1b0b099f9664 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029917 Jun 23 22:40:36.941337 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 270/515] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:40:57.049937 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=46 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:40:57.050683 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:40:57.055190 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f8d94e1a-fd04-471b-ac04-ae5aa7ffd518 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:57.056224 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-f8d94e1a-fd04-471b-ac04-ae5aa7ffd518 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:57.063392 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f8d94e1a-fd04-471b-ac04-ae5aa7ffd518 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:57.063839 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f8d94e1a-fd04-471b-ac04-ae5aa7ffd518 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:57.064629 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f8d94e1a-fd04-471b-ac04-ae5aa7ffd518 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:57.065063 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f8d94e1a-fd04-471b-ac04-ae5aa7ffd518 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:57.095329 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f8d94e1a-fd04-471b-ac04-ae5aa7ffd518 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046963 Jun 23 22:40:57.095888 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 246/516] 10.222.0.43 () {58 vars in 1301 bytes} [Thu Jun 23 22:40:57 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 22:40:57.157001 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:40:57.157757 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell1:SELECT=12 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:40:57.162291 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-26286345-4c34-467e-93b7-287f7040ac7c tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:57.163920 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-26286345-4c34-467e-93b7-287f7040ac7c tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:57.172009 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-26286345-4c34-467e-93b7-287f7040ac7c tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:57.172449 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-26286345-4c34-467e-93b7-287f7040ac7c tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:57.173199 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-26286345-4c34-467e-93b7-287f7040ac7c tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:57.173621 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-26286345-4c34-467e-93b7-287f7040ac7c tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:57.200333 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-26286345-4c34-467e-93b7-287f7040ac7c tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Going to try to terminate instance {{(pid=124357) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:40:57.278605 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-26286345-4c34-467e-93b7-287f7040ac7c tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 204 len: 0 microversion: 2.1 time: 0.124882 Jun 23 22:40:57.279131 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 271/517] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 23 22:40:57 2022] DELETE /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 22:40:57.287266 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-22c19268-68d0-4408-8704-8acd72afc3c0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:57.288954 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-22c19268-68d0-4408-8704-8acd72afc3c0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:57.295360 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-22c19268-68d0-4408-8704-8acd72afc3c0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:57.295799 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-22c19268-68d0-4408-8704-8acd72afc3c0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:57.296584 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-22c19268-68d0-4408-8704-8acd72afc3c0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:57.297006 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-22c19268-68d0-4408-8704-8acd72afc3c0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:57.486319 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-22c19268-68d0-4408-8704-8acd72afc3c0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:57.494439 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-22c19268-68d0-4408-8704-8acd72afc3c0 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1671 microversion: 2.1 time: 0.210919 Jun 23 22:40:57.495024 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 247/518] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:57 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1671 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:40:58.615567 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-3cd39595-a92a-426e-b8d4-f9d653786cc5 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:58.616368 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-3cd39595-a92a-426e-b8d4-f9d653786cc5 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:58.622394 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3cd39595-a92a-426e-b8d4-f9d653786cc5 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:58.622844 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3cd39595-a92a-426e-b8d4-f9d653786cc5 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:58.623641 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3cd39595-a92a-426e-b8d4-f9d653786cc5 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:58.624077 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3cd39595-a92a-426e-b8d4-f9d653786cc5 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:58.804079 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-3cd39595-a92a-426e-b8d4-f9d653786cc5 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:58.811730 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-3cd39595-a92a-426e-b8d4-f9d653786cc5 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1671 microversion: 2.1 time: 0.303454 Jun 23 22:40:58.812292 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 272/519] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:58 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1671 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:40:59.829295 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a84628b6-fab4-466b-bd74-f16452558d52 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:40:59.829916 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-a84628b6-fab4-466b-bd74-f16452558d52 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:40:59.837103 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a84628b6-fab4-466b-bd74-f16452558d52 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:59.837544 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a84628b6-fab4-466b-bd74-f16452558d52 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:59.838310 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a84628b6-fab4-466b-bd74-f16452558d52 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:40:59.838743 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a84628b6-fab4-466b-bd74-f16452558d52 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:40:59.964818 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-a84628b6-fab4-466b-bd74-f16452558d52 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:40:59.972268 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-a84628b6-fab4-466b-bd74-f16452558d52 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1671 microversion: 2.1 time: 0.146808 Jun 23 22:40:59.972839 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 248/520] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:40:59 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1671 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:00.989745 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-4c6eb76f-fdcc-40fb-b061-16c652896479 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:00.990389 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-4c6eb76f-fdcc-40fb-b061-16c652896479 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:00.997572 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-4c6eb76f-fdcc-40fb-b061-16c652896479 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:00.998037 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-4c6eb76f-fdcc-40fb-b061-16c652896479 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:00.998846 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-4c6eb76f-fdcc-40fb-b061-16c652896479 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:00.999284 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-4c6eb76f-fdcc-40fb-b061-16c652896479 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:01.199248 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-4c6eb76f-fdcc-40fb-b061-16c652896479 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:01.206658 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-4c6eb76f-fdcc-40fb-b061-16c652896479 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 200 len: 1671 microversion: 2.1 time: 0.220947 Jun 23 22:41:01.207244 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 273/521] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:00 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 1671 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:01.569122 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-7291a98d-3147-4573-8c70-9e24b641822f req-cb028e38-06e7-4f89-8fec-20ff4bb71f00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f910ba21-0126-4f09-8fd9-10f2365e67c1", "name": "network-vif-deleted", "tag": "1d0ff831-0151-424d-bdac-c933fd397da7"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:41:01.581359 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-7291a98d-3147-4573-8c70-9e24b641822f req-cb028e38-06e7-4f89-8fec-20ff4bb71f00 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:01.581886 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-7291a98d-3147-4573-8c70-9e24b641822f req-cb028e38-06e7-4f89-8fec-20ff4bb71f00 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:01.595837 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-7291a98d-3147-4573-8c70-9e24b641822f req-cb028e38-06e7-4f89-8fec-20ff4bb71f00 service nova] Creating event network-vif-deleted:1d0ff831-0151-424d-bdac-c933fd397da7 for instance f910ba21-0126-4f09-8fd9-10f2365e67c1 on hv-cinder-84617 Jun 23 22:41:01.602370 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-7291a98d-3147-4573-8c70-9e24b641822f req-cb028e38-06e7-4f89-8fec-20ff4bb71f00 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037205 Jun 23 22:41:01.603306 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 249/522] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:41:02.224234 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-a33fa0c9-9592-4e83-9091-c216a053a2a6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:02.224846 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-a33fa0c9-9592-4e83-9091-c216a053a2a6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:02.232389 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a33fa0c9-9592-4e83-9091-c216a053a2a6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:02.232838 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a33fa0c9-9592-4e83-9091-c216a053a2a6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:02.233714 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a33fa0c9-9592-4e83-9091-c216a053a2a6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:02.234108 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a33fa0c9-9592-4e83-9091-c216a053a2a6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:02.249235 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.wsgi [None req-a33fa0c9-9592-4e83-9091-c216a053a2a6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] HTTP exception thrown: Instance f910ba21-0126-4f09-8fd9-10f2365e67c1 could not be found. Jun 23 22:41:02.251188 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-a33fa0c9-9592-4e83-9091-c216a053a2a6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Request method failure captured: Jun 23 22:41:02.251188 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: request: GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 HTTP/1.1 Jun 23 22:41:02.251188 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept: application/json Jun 23 22:41:02.251188 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept-Encoding: identity Jun 23 22:41:02.251188 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Connection: close Jun 23 22:41:02.251188 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Length: 0 Jun 23 22:41:02.251188 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Type: application/json Jun 23 22:41:02.251188 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Host: 10.222.0.43 Jun 23 22:41:02.251188 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Openstack-System-Scope: None Jun 23 22:41:02.251188 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: User-Agent: python-urllib3/1.26.9 Jun 23 22:41:02.251188 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Auth-Token: gAAAAABitOrNxmV92J7HcqRKDnbLLScwyCGv0L9ksVybP612zzZsPH1Fbo95rUcrWObQOTNcnKOBO9s7WMb5HMS3lEYgs7t-huHaMcgwnmI7nPnFqhsw99NVC0fqD2NaTOhENFcPEMHt9sAMGbvh7mmigmY8jxF5vcH9XQyBSAlnhZd8-aA7Z_o Jun 23 22:41:02.251188 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Id: None Jun 23 22:41:02.251188 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Name: None Jun 23 22:41:02.251188 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Identity-Status: Confirmed Jun 23 22:41:02.251188 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Is-Admin-Project: True Jun 23 22:41:02.251188 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Id: default Jun 23 22:41:02.251188 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Name: Default Jun 23 22:41:02.251188 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Id: c751cc6b8ac64f3fb7adc9bc71575bd2 Jun 23 22:41:02.251188 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Name: tempest-AttachVolumeTestJSON-545622694 Jun 23 22:41:02.251188 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Role: reader,member Jun 23 22:41:02.251188 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Roles: reader,member Jun 23 22:41:02.252755 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c751cc6b8ac64f3fb7adc9bc71575bd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c751cc6b8ac64f3fb7adc9bc71575bd2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c751cc6b8ac64f3fb7adc9bc71575bd2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c751cc6b8ac64f3fb7adc9bc71575bd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:41:02.252755 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant: tempest-AttachVolumeTestJSON-545622694 Jun 23 22:41:02.252755 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Id: c751cc6b8ac64f3fb7adc9bc71575bd2 Jun 23 22:41:02.252755 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Name: tempest-AttachVolumeTestJSON-545622694 Jun 23 22:41:02.252755 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User: tempest-AttachVolumeTestJSON-545622694-project Jun 23 22:41:02.252755 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Id: default Jun 23 22:41:02.252755 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Name: Default Jun 23 22:41:02.252755 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Id: f53284773f7a430db3d0e16d3c2cd262 Jun 23 22:41:02.252755 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Name: tempest-AttachVolumeTestJSON-545622694-project Jun 23 22:41:02.252755 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: method: > Jun 23 22:41:02.252755 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: exception: Instance f910ba21-0126-4f09-8fd9-10f2365e67c1 could not be found. Jun 23 22:41:02.252755 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: action_args: {'id': 'f910ba21-0126-4f09-8fd9-10f2365e67c1'} Jun 23 22:41:02.253981 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:41:02.253981 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:41:02.253981 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:41:02.253981 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:41:02.253981 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:41:02.253981 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:41:02.253981 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:41:02.253981 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:41:02.253981 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:41:02.253981 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:41:02.253981 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f910ba21-0126-4f09-8fd9-10f2365e67c1 could not be found. Jun 23 22:41:02.253981 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:41:02.253981 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:41:02.253981 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:41:02.253981 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:41:02.253981 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:41:02.253981 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:41:02.253981 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:41:02.253981 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:41:02.253981 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:41:02.255576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:41:02.255576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:41:02.255576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:41:02.255576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:41:02.255576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:41:02.255576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:41:02.255576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:41:02.255576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f910ba21-0126-4f09-8fd9-10f2365e67c1 could not be found. Jun 23 22:41:02.255576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:41:02.255576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:41:02.255576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:41:02.255576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:41:02.255576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:41:02.255576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:41:02.255576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:41:02.255576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:41:02.255576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f910ba21-0126-4f09-8fd9-10f2365e67c1 could not be found. Jun 23 22:41:02.255576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:41:02.257711 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-a33fa0c9-9592-4e83-9091-c216a053a2a6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Returning 404 to user: Instance f910ba21-0126-4f09-8fd9-10f2365e67c1 could not be found. {{(pid=124357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:41:02.257711 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-a33fa0c9-9592-4e83-9091-c216a053a2a6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 404 len: 111 microversion: 2.1 time: 0.032274 Jun 23 22:41:02.257711 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 274/523] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:02 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:41:02.262873 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-3d6756b6-6385-4394-b530-b8179555855b tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '.version_select at 0x7fb719729dc0>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:02.283434 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-3d6756b6-6385-4394-b530-b8179555855b tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1435201750" status: 202 len: 0 microversion: 2.1 time: 0.024938 Jun 23 22:41:02.284017 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 250/524] 10.222.0.43 () {58 vars in 1220 bytes} [Thu Jun 23 22:41:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1435201750 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:41:02.926078 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-22604190-bf1c-4731-a82f-1b427d0f90bf tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Action: 'create', calling method: .version_select at 0x7fb7197b4dc0>, body: {"keypair": {"name": "tempest-keypair-2099321125", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXDC9aHV0iUZ6UXQIV9scuxrno8Resfp8Bn+Ykgl9OKgs9Qnlpbfe24YqlxhrhsNmW/kLg6cWCIyVlmGoVqaGKHPS92SKCFoepl2qx+q68HfExBxPagGJPHNxKw1926pg=="}} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:41:02.940871 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-22604190-bf1c-4731-a82f-1b427d0f90bf tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Getting quotas for project c751cc6b8ac64f3fb7adc9bc71575bd2. Resources: {'key_pairs'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:41:02.944767 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-22604190-bf1c-4731-a82f-1b427d0f90bf tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Getting quotas for user f53284773f7a430db3d0e16d3c2cd262 and project c751cc6b8ac64f3fb7adc9bc71575bd2. Resources: {'key_pairs'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:41:02.967704 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-22604190-bf1c-4731-a82f-1b427d0f90bf tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045409 Jun 23 22:41:02.968304 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 275/525] 10.222.0.43 () {60 vars in 1158 bytes} [Thu Jun 23 22:41:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:41:04.322849 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d08ae7cf-e5be-4bb9-9245-c1a6fd245925 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1952996897", "imageRef": "ac7d441e-2ac8-49ad-9dc5-3c55bd4b4f8b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "69c6d8a0-202c-42d8-bb93-5c3836a8475f"}], "security_groups": [{"name": "tempest-securitygroup--1422317950"}], "key_name": "tempest-keypair-2099321125", "user_data": "}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:41:04.422483 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.network.neutron [None req-d08ae7cf-e5be-4bb9-9245-c1a6fd245925 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] validate_networks() for [('69c6d8a0-202c-42d8-bb93-5c3836a8475f', None, None, None, None, None)] {{(pid=124358) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:41:04.783325 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-d08ae7cf-e5be-4bb9-9245-c1a6fd245925 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Flavor limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:41:04.783748 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-d08ae7cf-e5be-4bb9-9245-c1a6fd245925 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Image limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:41:04.784217 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-d08ae7cf-e5be-4bb9-9245-c1a6fd245925 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Flavor pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:41:04.784631 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-d08ae7cf-e5be-4bb9-9245-c1a6fd245925 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Image pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:41:04.785040 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-d08ae7cf-e5be-4bb9-9245-c1a6fd245925 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:41:04.794992 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d08ae7cf-e5be-4bb9-9245-c1a6fd245925 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:04.795437 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d08ae7cf-e5be-4bb9-9245-c1a6fd245925 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:04.796229 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d08ae7cf-e5be-4bb9-9245-c1a6fd245925 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:04.796658 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d08ae7cf-e5be-4bb9-9245-c1a6fd245925 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:04.813812 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-d08ae7cf-e5be-4bb9-9245-c1a6fd245925 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Getting quotas for project c751cc6b8ac64f3fb7adc9bc71575bd2. Resources: {'instances', 'cores', 'ram'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:41:04.817739 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-d08ae7cf-e5be-4bb9-9245-c1a6fd245925 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Getting quotas for user f53284773f7a430db3d0e16d3c2cd262 and project c751cc6b8ac64f3fb7adc9bc71575bd2. Resources: {'instances', 'cores', 'ram'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:41:04.829128 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-d08ae7cf-e5be-4bb9-9245-c1a6fd245925 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Going to run 1 instances... {{(pid=124358) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:41:04.831462 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-d08ae7cf-e5be-4bb9-9245-c1a6fd245925 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: 3125a0e6-6f0f-408b-8d73-08610945e52e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ac7d441e-2ac8-49ad-9dc5-3c55bd4b4f8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:41:04.877157 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d08ae7cf-e5be-4bb9-9245-c1a6fd245925 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.559082 Jun 23 22:41:04.877804 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 251/526] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Jun 23 22:41:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 22:41:04.887944 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-c1bf081e-3629-4695-bd2b-d63b91688417 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:04.888580 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-c1bf081e-3629-4695-bd2b-d63b91688417 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: 3125a0e6-6f0f-408b-8d73-08610945e52e] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:04.951353 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-c1bf081e-3629-4695-bd2b-d63b91688417 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:04.958518 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-c1bf081e-3629-4695-bd2b-d63b91688417 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e" status: 200 len: 1238 microversion: 2.1 time: 0.074428 Jun 23 22:41:04.959352 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 276/527] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:04 2022] GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e => generated 1238 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:05.976650 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-1022a81d-4071-4559-8dfa-9ede88a2c608 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:05.977410 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-1022a81d-4071-4559-8dfa-9ede88a2c608 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: 3125a0e6-6f0f-408b-8d73-08610945e52e] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:05.983807 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1022a81d-4071-4559-8dfa-9ede88a2c608 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:05.984253 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1022a81d-4071-4559-8dfa-9ede88a2c608 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:05.985014 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1022a81d-4071-4559-8dfa-9ede88a2c608 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:05.985446 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1022a81d-4071-4559-8dfa-9ede88a2c608 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:06.059284 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-1022a81d-4071-4559-8dfa-9ede88a2c608 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:06.066734 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-1022a81d-4071-4559-8dfa-9ede88a2c608 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e" status: 200 len: 1290 microversion: 2.1 time: 0.095271 Jun 23 22:41:06.076488 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 252/528] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:05 2022] GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e => generated 1290 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:07.084343 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-13b1b9b2-555f-43ba-a053-5ac038051e98 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:07.084943 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-13b1b9b2-555f-43ba-a053-5ac038051e98 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: 3125a0e6-6f0f-408b-8d73-08610945e52e] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:07.092233 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-13b1b9b2-555f-43ba-a053-5ac038051e98 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:07.092703 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-13b1b9b2-555f-43ba-a053-5ac038051e98 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:07.093462 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-13b1b9b2-555f-43ba-a053-5ac038051e98 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:07.093892 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-13b1b9b2-555f-43ba-a053-5ac038051e98 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:07.294302 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-13b1b9b2-555f-43ba-a053-5ac038051e98 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:07.302368 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-13b1b9b2-555f-43ba-a053-5ac038051e98 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e" status: 200 len: 1364 microversion: 2.1 time: 0.222228 Jun 23 22:41:07.303145 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 277/529] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:07 2022] GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e => generated 1364 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:07.572967 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-b87f5644-4b81-4160-97e7-c817e3abeca4 req-e7d7f1a8-33c9-4d36-bc46-91ddfdf5a702 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3125a0e6-6f0f-408b-8d73-08610945e52e", "tag": "60973a16-fee9-49ee-acd2-8876865316c0"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:41:07.589113 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-b87f5644-4b81-4160-97e7-c817e3abeca4 req-e7d7f1a8-33c9-4d36-bc46-91ddfdf5a702 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:07.589582 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-b87f5644-4b81-4160-97e7-c817e3abeca4 req-e7d7f1a8-33c9-4d36-bc46-91ddfdf5a702 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:07.605163 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-b87f5644-4b81-4160-97e7-c817e3abeca4 req-e7d7f1a8-33c9-4d36-bc46-91ddfdf5a702 service nova] Creating event network-changed:60973a16-fee9-49ee-acd2-8876865316c0 for instance 3125a0e6-6f0f-408b-8d73-08610945e52e on hv-cinder-84617 Jun 23 22:41:07.609956 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-b87f5644-4b81-4160-97e7-c817e3abeca4 req-e7d7f1a8-33c9-4d36-bc46-91ddfdf5a702 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041708 Jun 23 22:41:07.610474 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 253/530] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:41:08.321588 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-d42867a2-8cd5-41e5-9d11-b77835931995 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:08.322164 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-d42867a2-8cd5-41e5-9d11-b77835931995 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: 3125a0e6-6f0f-408b-8d73-08610945e52e] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:08.328684 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d42867a2-8cd5-41e5-9d11-b77835931995 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:08.329125 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d42867a2-8cd5-41e5-9d11-b77835931995 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:08.329879 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d42867a2-8cd5-41e5-9d11-b77835931995 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:08.330316 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d42867a2-8cd5-41e5-9d11-b77835931995 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:08.462148 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-d42867a2-8cd5-41e5-9d11-b77835931995 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:08.470126 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-d42867a2-8cd5-41e5-9d11-b77835931995 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e" status: 200 len: 1364 microversion: 2.1 time: 0.152252 Jun 23 22:41:08.470753 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 278/531] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:08 2022] GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:09.488306 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a2430973-affb-4b44-a73b-5d124f29ce27 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:09.489002 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-a2430973-affb-4b44-a73b-5d124f29ce27 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: 3125a0e6-6f0f-408b-8d73-08610945e52e] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:09.496029 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a2430973-affb-4b44-a73b-5d124f29ce27 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:09.496475 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a2430973-affb-4b44-a73b-5d124f29ce27 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:09.497278 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a2430973-affb-4b44-a73b-5d124f29ce27 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:09.497712 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a2430973-affb-4b44-a73b-5d124f29ce27 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:09.708484 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-a2430973-affb-4b44-a73b-5d124f29ce27 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:09.716439 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-a2430973-affb-4b44-a73b-5d124f29ce27 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e" status: 200 len: 1364 microversion: 2.1 time: 0.232789 Jun 23 22:41:09.717003 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 254/532] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:09 2022] GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e => generated 1364 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:10.733247 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-84f362ff-5fde-4878-a5af-363f947caa64 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:10.733902 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-84f362ff-5fde-4878-a5af-363f947caa64 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: 3125a0e6-6f0f-408b-8d73-08610945e52e] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:10.740581 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-84f362ff-5fde-4878-a5af-363f947caa64 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:10.741025 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-84f362ff-5fde-4878-a5af-363f947caa64 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:10.742655 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-84f362ff-5fde-4878-a5af-363f947caa64 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:10.743129 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-84f362ff-5fde-4878-a5af-363f947caa64 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:10.879253 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-84f362ff-5fde-4878-a5af-363f947caa64 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:10.887224 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-84f362ff-5fde-4878-a5af-363f947caa64 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e" status: 200 len: 1364 microversion: 2.1 time: 0.157693 Jun 23 22:41:10.887800 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 279/533] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:10 2022] GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:11.904500 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-9ee0c8d9-00c7-4bf6-877f-79aa5dda84db tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:11.905114 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-9ee0c8d9-00c7-4bf6-877f-79aa5dda84db tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: 3125a0e6-6f0f-408b-8d73-08610945e52e] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:11.911612 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9ee0c8d9-00c7-4bf6-877f-79aa5dda84db tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:11.912061 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9ee0c8d9-00c7-4bf6-877f-79aa5dda84db tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:11.912827 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9ee0c8d9-00c7-4bf6-877f-79aa5dda84db tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:11.913559 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9ee0c8d9-00c7-4bf6-877f-79aa5dda84db tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:12.058265 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-9ee0c8d9-00c7-4bf6-877f-79aa5dda84db tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:12.065726 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-9ee0c8d9-00c7-4bf6-877f-79aa5dda84db tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e" status: 200 len: 1364 microversion: 2.1 time: 0.165073 Jun 23 22:41:12.066301 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 255/534] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:11 2022] GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:13.083070 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-8aeec42b-d761-49cc-9e45-196c22a037a2 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:13.083686 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-8aeec42b-d761-49cc-9e45-196c22a037a2 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: 3125a0e6-6f0f-408b-8d73-08610945e52e] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:13.090792 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-8aeec42b-d761-49cc-9e45-196c22a037a2 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:13.091270 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-8aeec42b-d761-49cc-9e45-196c22a037a2 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:13.092024 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-8aeec42b-d761-49cc-9e45-196c22a037a2 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:13.092463 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-8aeec42b-d761-49cc-9e45-196c22a037a2 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:13.220586 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-8aeec42b-d761-49cc-9e45-196c22a037a2 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:13.228035 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-8aeec42b-d761-49cc-9e45-196c22a037a2 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e" status: 200 len: 1364 microversion: 2.1 time: 0.148827 Jun 23 22:41:13.228593 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 280/535] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:13 2022] GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:13.443168 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-0332f260-5108-4f2f-ab9b-d8b5fd053e64 req-33405a24-9793-4309-9d3a-ada60dcec3b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3125a0e6-6f0f-408b-8d73-08610945e52e", "name": "network-vif-plugged", "status": "completed", "tag": "60973a16-fee9-49ee-acd2-8876865316c0"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:41:13.452435 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-0332f260-5108-4f2f-ab9b-d8b5fd053e64 req-33405a24-9793-4309-9d3a-ada60dcec3b2 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:13.452859 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-0332f260-5108-4f2f-ab9b-d8b5fd053e64 req-33405a24-9793-4309-9d3a-ada60dcec3b2 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:13.465427 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-0332f260-5108-4f2f-ab9b-d8b5fd053e64 req-33405a24-9793-4309-9d3a-ada60dcec3b2 service nova] Creating event network-vif-plugged:60973a16-fee9-49ee-acd2-8876865316c0 for instance 3125a0e6-6f0f-408b-8d73-08610945e52e on hv-cinder-84617 Jun 23 22:41:13.470168 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-0332f260-5108-4f2f-ab9b-d8b5fd053e64 req-33405a24-9793-4309-9d3a-ada60dcec3b2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030738 Jun 23 22:41:13.470760 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 256/536] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:41:14.245301 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-701dcac8-3cdf-4f81-a5ee-e8a0a318cbed tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:14.245986 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-701dcac8-3cdf-4f81-a5ee-e8a0a318cbed tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: 3125a0e6-6f0f-408b-8d73-08610945e52e] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:14.252525 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-701dcac8-3cdf-4f81-a5ee-e8a0a318cbed tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:14.252964 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-701dcac8-3cdf-4f81-a5ee-e8a0a318cbed tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:14.253707 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-701dcac8-3cdf-4f81-a5ee-e8a0a318cbed tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:14.254131 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-701dcac8-3cdf-4f81-a5ee-e8a0a318cbed tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:14.385379 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-701dcac8-3cdf-4f81-a5ee-e8a0a318cbed tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:14.392819 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-701dcac8-3cdf-4f81-a5ee-e8a0a318cbed tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e" status: 200 len: 1364 microversion: 2.1 time: 0.151996 Jun 23 22:41:14.393378 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 281/537] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:14 2022] GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:15.407273 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=2 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:41:15.407953 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=6 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:41:15.412428 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-522053c8-8c05-4e19-880a-deac7595da13 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:15.413607 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-522053c8-8c05-4e19-880a-deac7595da13 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: 3125a0e6-6f0f-408b-8d73-08610945e52e] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:15.420821 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-522053c8-8c05-4e19-880a-deac7595da13 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:15.421233 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-522053c8-8c05-4e19-880a-deac7595da13 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:15.422192 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-522053c8-8c05-4e19-880a-deac7595da13 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:15.422634 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-522053c8-8c05-4e19-880a-deac7595da13 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:15.552096 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-522053c8-8c05-4e19-880a-deac7595da13 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:15.560384 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-522053c8-8c05-4e19-880a-deac7595da13 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e" status: 200 len: 1364 microversion: 2.1 time: 0.154621 Jun 23 22:41:15.560952 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 257/538] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:15 2022] GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:16.578078 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-6d8482c2-dd54-445d-881b-7537c51723af tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:16.578687 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-6d8482c2-dd54-445d-881b-7537c51723af tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: 3125a0e6-6f0f-408b-8d73-08610945e52e] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:16.580678 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell0:SELECT=6 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:41:16.586868 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6d8482c2-dd54-445d-881b-7537c51723af tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:16.587334 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6d8482c2-dd54-445d-881b-7537c51723af tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:16.588089 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6d8482c2-dd54-445d-881b-7537c51723af tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:16.588520 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6d8482c2-dd54-445d-881b-7537c51723af tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:16.714352 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-6d8482c2-dd54-445d-881b-7537c51723af tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:16.721736 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-6d8482c2-dd54-445d-881b-7537c51723af tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e" status: 200 len: 1550 microversion: 2.1 time: 0.147519 Jun 23 22:41:16.722301 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 282/539] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:16 2022] GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e => generated 1550 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:16.739507 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-aa4000c9-7e9e-459c-ba8b-73a3d0daf6b4 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:16.740005 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-aa4000c9-7e9e-459c-ba8b-73a3d0daf6b4 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: 3125a0e6-6f0f-408b-8d73-08610945e52e] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:16.746740 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-aa4000c9-7e9e-459c-ba8b-73a3d0daf6b4 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:16.747211 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-aa4000c9-7e9e-459c-ba8b-73a3d0daf6b4 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:16.747964 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-aa4000c9-7e9e-459c-ba8b-73a3d0daf6b4 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:16.748389 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-aa4000c9-7e9e-459c-ba8b-73a3d0daf6b4 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:16.825450 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-aa4000c9-7e9e-459c-ba8b-73a3d0daf6b4 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089654 Jun 23 22:41:16.826027 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 258/540] 10.222.0.43 () {58 vars in 1274 bytes} [Thu Jun 23 22:41:16 2022] GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:41:17.717692 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [req-a4e77c4e-ffd2-4d49-b865-27cc63bae4f5 req-0fd1bcf4-0782-4191-a040-1009d6573664 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3125a0e6-6f0f-408b-8d73-08610945e52e", "tag": "60973a16-fee9-49ee-acd2-8876865316c0"}]} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:41:17.727469 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-a4e77c4e-ffd2-4d49-b865-27cc63bae4f5 req-0fd1bcf4-0782-4191-a040-1009d6573664 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:17.728180 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-a4e77c4e-ffd2-4d49-b865-27cc63bae4f5 req-0fd1bcf4-0782-4191-a040-1009d6573664 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:17.740639 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.compute.server_external_events [req-a4e77c4e-ffd2-4d49-b865-27cc63bae4f5 req-0fd1bcf4-0782-4191-a040-1009d6573664 service nova] Creating event network-changed:60973a16-fee9-49ee-acd2-8876865316c0 for instance 3125a0e6-6f0f-408b-8d73-08610945e52e on hv-cinder-84617 Jun 23 22:41:17.746325 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [req-a4e77c4e-ffd2-4d49-b865-27cc63bae4f5 req-0fd1bcf4-0782-4191-a040-1009d6573664 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032265 Jun 23 22:41:17.747013 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 283/541] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:41:22.319793 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-2d3d09d3-df88-4e7c-8b0b-3c8bbc8f87b4 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:22.320372 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-2d3d09d3-df88-4e7c-8b0b-3c8bbc8f87b4 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: e085b10f-a993-4e81-963d-0006a6431b67] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:22.327866 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2d3d09d3-df88-4e7c-8b0b-3c8bbc8f87b4 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:22.328310 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2d3d09d3-df88-4e7c-8b0b-3c8bbc8f87b4 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:22.329078 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2d3d09d3-df88-4e7c-8b0b-3c8bbc8f87b4 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:22.329509 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2d3d09d3-df88-4e7c-8b0b-3c8bbc8f87b4 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:22.353182 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-2d3d09d3-df88-4e7c-8b0b-3c8bbc8f87b4 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67/ips" status: 200 len: 150 microversion: 2.1 time: 0.089317 Jun 23 22:41:22.353737 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 259/542] 10.222.0.43 () {58 vars in 1247 bytes} [Thu Jun 23 22:41:22 2022] GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67/ips => generated 150 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:41:22.693142 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-c4d02c89-3178-4bfd-a904-881760621b16 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:22.693742 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-c4d02c89-3178-4bfd-a904-881760621b16 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:22.699952 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c4d02c89-3178-4bfd-a904-881760621b16 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:22.700390 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c4d02c89-3178-4bfd-a904-881760621b16 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:22.701130 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c4d02c89-3178-4bfd-a904-881760621b16 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:22.701554 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c4d02c89-3178-4bfd-a904-881760621b16 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:22.781997 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.objects.instance [None req-c4d02c89-3178-4bfd-a904-881760621b16 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lazy-loading 'services' on Instance uuid 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b {{(pid=124357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:41:22.894508 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-c4d02c89-3178-4bfd-a904-881760621b16 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "DELETE /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b/os-volume_attachments/9659d8f6-7895-409e-a775-6d2be766f904" status: 202 len: 0 microversion: 2.1 time: 0.205967 Jun 23 22:41:22.895125 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 284/543] 10.222.0.43 () {58 vars in 1415 bytes} [Thu Jun 23 22:41:22 2022] DELETE /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b/os-volume_attachments/9659d8f6-7895-409e-a775-6d2be766f904 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:41:22.903663 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-89d187ec-db5c-4424-85e8-393ddc0ef34d tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:22.904522 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-89d187ec-db5c-4424-85e8-393ddc0ef34d tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:22.910484 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-89d187ec-db5c-4424-85e8-393ddc0ef34d tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:22.910939 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-89d187ec-db5c-4424-85e8-393ddc0ef34d tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:22.911705 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-89d187ec-db5c-4424-85e8-393ddc0ef34d tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:22.912132 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-89d187ec-db5c-4424-85e8-393ddc0ef34d tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:22.945979 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-89d187ec-db5c-4424-85e8-393ddc0ef34d tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046216 Jun 23 22:41:22.946556 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 260/544] 10.222.0.43 () {58 vars in 1301 bytes} [Thu Jun 23 22:41:22 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:41:23.672724 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-df3ccdea-e292-4bef-9124-49d53483fe9f tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce1b81a0-6392-4262-b8e9-995879e8bf29"}} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:41:23.673852 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-df3ccdea-e292-4bef-9124-49d53483fe9f tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: e085b10f-a993-4e81-963d-0006a6431b67] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:23.679991 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-df3ccdea-e292-4bef-9124-49d53483fe9f tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:23.680459 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-df3ccdea-e292-4bef-9124-49d53483fe9f tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:23.681200 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-df3ccdea-e292-4bef-9124-49d53483fe9f tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:23.681623 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-df3ccdea-e292-4bef-9124-49d53483fe9f tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:23.932464 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-df3ccdea-e292-4bef-9124-49d53483fe9f tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "POST /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263750 Jun 23 22:41:23.933108 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 285/545] 10.222.0.43 () {60 vars in 1322 bytes} [Thu Jun 23 22:41:23 2022] POST /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:41:23.960340 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-fd328b41-9e82-4bc7-9674-f065675e96f3 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:23.961335 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-fd328b41-9e82-4bc7-9674-f065675e96f3 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:23.971038 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fd328b41-9e82-4bc7-9674-f065675e96f3 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:23.971497 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fd328b41-9e82-4bc7-9674-f065675e96f3 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:23.972465 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fd328b41-9e82-4bc7-9674-f065675e96f3 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:23.973074 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fd328b41-9e82-4bc7-9674-f065675e96f3 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:24.009910 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-fd328b41-9e82-4bc7-9674-f065675e96f3 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055732 Jun 23 22:41:24.014385 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 261/546] 10.222.0.43 () {58 vars in 1301 bytes} [Thu Jun 23 22:41:23 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:41:25.022581 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-da9fb1bb-28f1-4c57-81e8-5f4b218533e6 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:25.023685 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-da9fb1bb-28f1-4c57-81e8-5f4b218533e6 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:25.030734 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-da9fb1bb-28f1-4c57-81e8-5f4b218533e6 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:25.031209 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-da9fb1bb-28f1-4c57-81e8-5f4b218533e6 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:25.031971 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-da9fb1bb-28f1-4c57-81e8-5f4b218533e6 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:25.032491 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-da9fb1bb-28f1-4c57-81e8-5f4b218533e6 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:25.061369 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-da9fb1bb-28f1-4c57-81e8-5f4b218533e6 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043516 Jun 23 22:41:25.061929 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 286/547] 10.222.0.43 () {58 vars in 1301 bytes} [Thu Jun 23 22:41:25 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 22:41:25.135747 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c91ef418-07dc-4468-ad62-42db76a0aa24 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:25.136252 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c91ef418-07dc-4468-ad62-42db76a0aa24 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:25.142810 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c91ef418-07dc-4468-ad62-42db76a0aa24 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:25.143288 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c91ef418-07dc-4468-ad62-42db76a0aa24 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:25.144089 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c91ef418-07dc-4468-ad62-42db76a0aa24 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:25.144520 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c91ef418-07dc-4468-ad62-42db76a0aa24 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:25.170696 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c91ef418-07dc-4468-ad62-42db76a0aa24 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Going to try to terminate instance {{(pid=124358) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:41:25.244199 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c91ef418-07dc-4468-ad62-42db76a0aa24 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "DELETE /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 204 len: 0 microversion: 2.1 time: 0.112774 Jun 23 22:41:25.245082 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 262/548] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 23 22:41:25 2022] DELETE /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 22:41:25.253479 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-9f46cedf-eeed-43ef-8843-85d947e0b8dd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:25.254022 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-9f46cedf-eeed-43ef-8843-85d947e0b8dd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:25.261391 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9f46cedf-eeed-43ef-8843-85d947e0b8dd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:25.261833 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9f46cedf-eeed-43ef-8843-85d947e0b8dd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:25.262589 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9f46cedf-eeed-43ef-8843-85d947e0b8dd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:25.263076 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9f46cedf-eeed-43ef-8843-85d947e0b8dd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:25.267305 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:41:25.392057 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-9f46cedf-eeed-43ef-8843-85d947e0b8dd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:25.399630 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-9f46cedf-eeed-43ef-8843-85d947e0b8dd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1689 microversion: 2.1 time: 0.149959 Jun 23 22:41:25.400192 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 287/549] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:25 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:41:26.417565 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-7e016779-270a-491f-a542-d4c40a82486d tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:26.418264 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-7e016779-270a-491f-a542-d4c40a82486d tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:26.424842 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7e016779-270a-491f-a542-d4c40a82486d tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:26.425283 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7e016779-270a-491f-a542-d4c40a82486d tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:26.426040 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7e016779-270a-491f-a542-d4c40a82486d tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:26.426470 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7e016779-270a-491f-a542-d4c40a82486d tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:26.560906 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-7e016779-270a-491f-a542-d4c40a82486d tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:26.568399 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-7e016779-270a-491f-a542-d4c40a82486d tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1689 microversion: 2.1 time: 0.155487 Jun 23 22:41:26.568958 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 263/550] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:26 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:27.585774 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-f6df8cd5-4fdf-40d6-ac4b-a0ca43b4b9fd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:27.586376 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-f6df8cd5-4fdf-40d6-ac4b-a0ca43b4b9fd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:27.589274 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:41:27.594667 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f6df8cd5-4fdf-40d6-ac4b-a0ca43b4b9fd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:27.595152 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f6df8cd5-4fdf-40d6-ac4b-a0ca43b4b9fd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:27.595936 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f6df8cd5-4fdf-40d6-ac4b-a0ca43b4b9fd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:27.596364 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f6df8cd5-4fdf-40d6-ac4b-a0ca43b4b9fd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:27.728872 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-f6df8cd5-4fdf-40d6-ac4b-a0ca43b4b9fd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:27.736337 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-f6df8cd5-4fdf-40d6-ac4b-a0ca43b4b9fd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1689 microversion: 2.1 time: 0.154784 Jun 23 22:41:27.736929 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 288/551] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:27 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:28.753055 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b0658c0e-663a-4d58-850a-c07f071e13d7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:28.753664 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-b0658c0e-663a-4d58-850a-c07f071e13d7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:28.755664 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:41:28.761045 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b0658c0e-663a-4d58-850a-c07f071e13d7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:28.761486 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b0658c0e-663a-4d58-850a-c07f071e13d7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:28.762243 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b0658c0e-663a-4d58-850a-c07f071e13d7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:28.762673 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b0658c0e-663a-4d58-850a-c07f071e13d7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:28.767345 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:41:28.896271 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b0658c0e-663a-4d58-850a-c07f071e13d7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:28.903756 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-b0658c0e-663a-4d58-850a-c07f071e13d7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1689 microversion: 2.1 time: 0.154674 Jun 23 22:41:28.904323 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 264/552] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:28 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:29.921166 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-65e2bca3-c478-493d-a679-8de04386bdc7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:29.921792 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-65e2bca3-c478-493d-a679-8de04386bdc7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:29.928421 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-65e2bca3-c478-493d-a679-8de04386bdc7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:29.928867 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-65e2bca3-c478-493d-a679-8de04386bdc7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:29.929636 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-65e2bca3-c478-493d-a679-8de04386bdc7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:29.930063 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-65e2bca3-c478-493d-a679-8de04386bdc7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:30.132682 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-65e2bca3-c478-493d-a679-8de04386bdc7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:30.140983 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-65e2bca3-c478-493d-a679-8de04386bdc7 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1689 microversion: 2.1 time: 0.223755 Jun 23 22:41:30.141781 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 289/553] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:29 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1689 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:30.580842 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-c5c165b3-1845-405c-b206-88c2de616e33 req-74e1912b-6100-4664-b403-881292395111 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b", "name": "network-vif-deleted", "tag": "e4f7fec0-2950-4a5c-8ce9-2b7668c8ae34"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:41:30.589971 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-c5c165b3-1845-405c-b206-88c2de616e33 req-74e1912b-6100-4664-b403-881292395111 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:30.590610 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-c5c165b3-1845-405c-b206-88c2de616e33 req-74e1912b-6100-4664-b403-881292395111 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:30.610909 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-c5c165b3-1845-405c-b206-88c2de616e33 req-74e1912b-6100-4664-b403-881292395111 service nova] Creating event network-vif-deleted:e4f7fec0-2950-4a5c-8ce9-2b7668c8ae34 for instance 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b on hv-cinder-84617 Jun 23 22:41:30.620804 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-c5c165b3-1845-405c-b206-88c2de616e33 req-74e1912b-6100-4664-b403-881292395111 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105589 Jun 23 22:41:30.621955 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 265/554] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:41:31.159932 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-03154902-b62a-4b4b-896f-84bcb1601c2e tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:31.160694 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-03154902-b62a-4b4b-896f-84bcb1601c2e tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:31.168690 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-03154902-b62a-4b4b-896f-84bcb1601c2e tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:31.169134 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-03154902-b62a-4b4b-896f-84bcb1601c2e tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:31.169900 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-03154902-b62a-4b4b-896f-84bcb1601c2e tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:31.170327 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-03154902-b62a-4b4b-896f-84bcb1601c2e tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:31.204012 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-03154902-b62a-4b4b-896f-84bcb1601c2e tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:31.204450 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-03154902-b62a-4b4b-896f-84bcb1601c2e tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:31.204893 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.objects.instance [None req-03154902-b62a-4b4b-896f-84bcb1601c2e tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lazy-loading 'fault' on Instance uuid 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b {{(pid=124357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:41:31.249833 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-03154902-b62a-4b4b-896f-84bcb1601c2e tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:31.257189 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-03154902-b62a-4b4b-896f-84bcb1601c2e tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 200 len: 1335 microversion: 2.1 time: 0.101369 Jun 23 22:41:31.259123 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 290/555] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:31 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 1335 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:31.428391 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-51ede749-0208-46b2-8c33-8b6b68091464 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce1b81a0-6392-4262-b8e9-995879e8bf29"}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:41:31.429525 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-51ede749-0208-46b2-8c33-8b6b68091464 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: e085b10f-a993-4e81-963d-0006a6431b67] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:31.436534 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-51ede749-0208-46b2-8c33-8b6b68091464 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:31.436973 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-51ede749-0208-46b2-8c33-8b6b68091464 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:31.437729 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-51ede749-0208-46b2-8c33-8b6b68091464 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:31.438154 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-51ede749-0208-46b2-8c33-8b6b68091464 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:31.516436 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-51ede749-0208-46b2-8c33-8b6b68091464 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] HTTP exception thrown: Invalid volume: volume ce1b81a0-6392-4262-b8e9-995879e8bf29 is already attached to instances: e085b10f-a993-4e81-963d-0006a6431b67 Jun 23 22:41:31.518150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-51ede749-0208-46b2-8c33-8b6b68091464 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Request method failure captured: Jun 23 22:41:31.518150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: request: POST /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67/os-volume_attachments HTTP/1.1 Jun 23 22:41:31.518150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept: application/json Jun 23 22:41:31.518150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Jun 23 22:41:31.518150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Connection: close Jun 23 22:41:31.518150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Length: 74 Jun 23 22:41:31.518150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Type: application/json Jun 23 22:41:31.518150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Host: 10.222.0.43 Jun 23 22:41:31.518150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Jun 23 22:41:31.518150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.9 Jun 23 22:41:31.518150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABitOrWyDITCi2PmBTdDblZ-ZSwK9B2UK_lIIWOMJB9Z-7YhxsoOI1DrhAeUCIChTCXv2hii5VV1HcTnkYXbW5bgXE95MCdJVwhuPtEsdt8Afqc-N7hZn6zZkza9EI9jSK71KcKdXUQCp4unsH4J6JfPLYATxcY6NVUnHVlcszTDCqSUi0 Jun 23 22:41:31.518150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Jun 23 22:41:31.518150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Jun 23 22:41:31.518150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Jun 23 22:41:31.518150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Jun 23 22:41:31.518150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Jun 23 22:41:31.518150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Jun 23 22:41:31.518150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Id: 2735e40fe2564a6d8a5cdc7c32b0b869 Jun 23 22:41:31.518150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:41:31.518150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Role: reader,member Jun 23 22:41:31.518150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Roles: reader,member Jun 23 22:41:31.519583 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2735e40fe2564a6d8a5cdc7c32b0b869", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:41:31.519583 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:41:31.519583 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Id: 2735e40fe2564a6d8a5cdc7c32b0b869 Jun 23 22:41:31.519583 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:41:31.519583 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User: tempest-AttachVolumeNegativeTest-184787456-project Jun 23 22:41:31.519583 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Jun 23 22:41:31.519583 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Jun 23 22:41:31.519583 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Id: 03486c7630314392b85271455d12aba2 Jun 23 22:41:31.519583 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-AttachVolumeNegativeTest-184787456-project Jun 23 22:41:31.519583 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Jun 23 22:41:31.519583 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: {"volumeAttachment": {"volumeId": "ce1b81a0-6392-4262-b8e9-995879e8bf29"}} Jun 23 22:41:31.519583 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: method: > Jun 23 22:41:31.520341 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: exception: Invalid volume: volume ce1b81a0-6392-4262-b8e9-995879e8bf29 is already attached to instances: e085b10f-a993-4e81-963d-0006a6431b67 Jun 23 22:41:31.520341 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: action_args: {'server_id': 'e085b10f-a993-4e81-963d-0006a6431b67', 'body': {'volumeAttachment': {'volumeId': 'ce1b81a0-6392-4262-b8e9-995879e8bf29'}}} Jun 23 22:41:31.520341 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:41:31.520341 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:41:31.520341 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 23 22:41:31.520341 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 23 22:41:31.520341 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 22:41:31.520341 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 22:41:31.520341 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 23 22:41:31.520341 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 23 22:41:31.520341 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 23 22:41:31.520341 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 23 22:41:31.520341 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 23 22:41:31.520341 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 23 22:41:31.520341 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ce1b81a0-6392-4262-b8e9-995879e8bf29 is already attached to instances: e085b10f-a993-4e81-963d-0006a6431b67 Jun 23 22:41:31.520341 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:41:31.520341 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:41:31.520341 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:41:31.520341 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:41:31.521531 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:41:31.521531 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:41:31.521531 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:41:31.521531 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:41:31.521531 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:41:31.521531 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:41:31.521531 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 22:41:31.521531 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 22:41:31.521531 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 22:41:31.521531 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 22:41:31.521531 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 22:41:31.521531 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 22:41:31.521531 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 23 22:41:31.521531 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 23 22:41:31.521531 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ce1b81a0-6392-4262-b8e9-995879e8bf29 is already attached to instances: e085b10f-a993-4e81-963d-0006a6431b67 Jun 23 22:41:31.521531 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:41:31.521531 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:41:31.521531 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:41:31.521531 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:41:31.521531 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:41:31.522821 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:41:31.522821 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:41:31.522821 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:41:31.522821 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ce1b81a0-6392-4262-b8e9-995879e8bf29 is already attached to instances: e085b10f-a993-4e81-963d-0006a6431b67 Jun 23 22:41:31.522821 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:41:31.522821 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-51ede749-0208-46b2-8c33-8b6b68091464 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Returning 400 to user: Invalid volume: volume ce1b81a0-6392-4262-b8e9-995879e8bf29 is already attached to instances: e085b10f-a993-4e81-963d-0006a6431b67 {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:41:31.522821 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-51ede749-0208-46b2-8c33-8b6b68091464 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "POST /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095610 Jun 23 22:41:31.522821 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 266/556] 10.222.0.43 () {60 vars in 1322 bytes} [Thu Jun 23 22:41:31 2022] POST /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 22:41:31.580134 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-6293ffe1-0595-46a9-bc2d-0e82b1eeb104 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:31.580626 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-6293ffe1-0595-46a9-bc2d-0e82b1eeb104 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: e085b10f-a993-4e81-963d-0006a6431b67] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:31.586877 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6293ffe1-0595-46a9-bc2d-0e82b1eeb104 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:31.587357 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6293ffe1-0595-46a9-bc2d-0e82b1eeb104 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:31.588658 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6293ffe1-0595-46a9-bc2d-0e82b1eeb104 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:31.589094 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6293ffe1-0595-46a9-bc2d-0e82b1eeb104 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:31.673725 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.objects.instance [None req-6293ffe1-0595-46a9-bc2d-0e82b1eeb104 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lazy-loading 'services' on Instance uuid e085b10f-a993-4e81-963d-0006a6431b67 {{(pid=124357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:41:31.745231 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-6293ffe1-0595-46a9-bc2d-0e82b1eeb104 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67/os-volume_attachments/ce1b81a0-6392-4262-b8e9-995879e8bf29" status: 202 len: 0 microversion: 2.1 time: 0.168169 Jun 23 22:41:31.745811 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 291/557] 10.222.0.43 () {58 vars in 1415 bytes} [Thu Jun 23 22:41:31 2022] DELETE /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67/os-volume_attachments/ce1b81a0-6392-4262-b8e9-995879e8bf29 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:41:31.756205 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f0bdf523-89cd-4843-8996-8df643ecb5c9 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:31.757999 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-f0bdf523-89cd-4843-8996-8df643ecb5c9 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: e085b10f-a993-4e81-963d-0006a6431b67] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:31.769618 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f0bdf523-89cd-4843-8996-8df643ecb5c9 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:31.770767 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f0bdf523-89cd-4843-8996-8df643ecb5c9 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:31.772207 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f0bdf523-89cd-4843-8996-8df643ecb5c9 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:31.772981 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f0bdf523-89cd-4843-8996-8df643ecb5c9 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:31.803395 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f0bdf523-89cd-4843-8996-8df643ecb5c9 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053123 Jun 23 22:41:31.803958 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 267/558] 10.222.0.43 () {58 vars in 1301 bytes} [Thu Jun 23 22:41:31 2022] GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:41:32.275784 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-4bae012a-6d7a-4ebf-9b7a-50d9c7b0ad4d tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:32.276481 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-4bae012a-6d7a-4ebf-9b7a-50d9c7b0ad4d tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:32.283890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-4bae012a-6d7a-4ebf-9b7a-50d9c7b0ad4d tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:32.284329 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-4bae012a-6d7a-4ebf-9b7a-50d9c7b0ad4d tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:32.285078 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-4bae012a-6d7a-4ebf-9b7a-50d9c7b0ad4d tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:32.285503 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-4bae012a-6d7a-4ebf-9b7a-50d9c7b0ad4d tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:32.299247 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.wsgi [None req-4bae012a-6d7a-4ebf-9b7a-50d9c7b0ad4d tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] HTTP exception thrown: Instance 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b could not be found. Jun 23 22:41:32.300833 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-4bae012a-6d7a-4ebf-9b7a-50d9c7b0ad4d tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Request method failure captured: Jun 23 22:41:32.300833 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: request: GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b HTTP/1.1 Jun 23 22:41:32.300833 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept: application/json Jun 23 22:41:32.300833 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept-Encoding: identity Jun 23 22:41:32.300833 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Connection: close Jun 23 22:41:32.300833 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Length: 0 Jun 23 22:41:32.300833 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Type: application/json Jun 23 22:41:32.300833 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Host: 10.222.0.43 Jun 23 22:41:32.300833 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Openstack-System-Scope: None Jun 23 22:41:32.300833 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: User-Agent: python-urllib3/1.26.9 Jun 23 22:41:32.300833 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Auth-Token: gAAAAABitOraLpi8Pvpi8Qc1Y4M-Pla8fum-8INT6fklVezA6HYJEy-_7LboWQXaqmKodYFNcJuBs2lqdl0aMvfex_YkVFYW6g3zGPxaMIBdBYAGSe9Z9h-akU9iV1MHzsT9eii0Id3pUsBpLUHlU69nBSDw0uRkdeq0OpdeT6mYb1v54X9To2I Jun 23 22:41:32.300833 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Id: None Jun 23 22:41:32.300833 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Name: None Jun 23 22:41:32.300833 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Identity-Status: Confirmed Jun 23 22:41:32.300833 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Is-Admin-Project: True Jun 23 22:41:32.300833 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Id: default Jun 23 22:41:32.300833 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Name: Default Jun 23 22:41:32.300833 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Id: 192d1c8d15ce462dbf10fc3b519ab253 Jun 23 22:41:32.300833 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-675175554 Jun 23 22:41:32.300833 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Role: reader,member Jun 23 22:41:32.300833 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Roles: reader,member Jun 23 22:41:32.302398 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/192d1c8d15ce462dbf10fc3b519ab253"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/192d1c8d15ce462dbf10fc3b519ab253"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_192d1c8d15ce462dbf10fc3b519ab253", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/192d1c8d15ce462dbf10fc3b519ab253"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:41:32.302398 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant: tempest-ServerRescueNegativeTestJSON-675175554 Jun 23 22:41:32.302398 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Id: 192d1c8d15ce462dbf10fc3b519ab253 Jun 23 22:41:32.302398 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-675175554 Jun 23 22:41:32.302398 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User: tempest-ServerRescueNegativeTestJSON-675175554-project Jun 23 22:41:32.302398 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Id: default Jun 23 22:41:32.302398 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Name: Default Jun 23 22:41:32.302398 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Id: dc246e144afc46698000f7f53ef6489e Jun 23 22:41:32.302398 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Name: tempest-ServerRescueNegativeTestJSON-675175554-project Jun 23 22:41:32.302398 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: method: > Jun 23 22:41:32.302398 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: exception: Instance 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b could not be found. Jun 23 22:41:32.302398 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: action_args: {'id': '05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b'} Jun 23 22:41:32.303374 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:41:32.303374 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:41:32.303374 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:41:32.303374 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:41:32.303374 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:41:32.303374 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:41:32.303374 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:41:32.303374 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:41:32.303374 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:41:32.303374 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:41:32.303374 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b could not be found. Jun 23 22:41:32.303374 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:41:32.303374 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:41:32.303374 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:41:32.303374 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:41:32.303374 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:41:32.303374 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:41:32.303374 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:41:32.303374 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:41:32.303374 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:41:32.304877 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:41:32.304877 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:41:32.304877 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:41:32.304877 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:41:32.304877 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:41:32.304877 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:41:32.304877 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:41:32.304877 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b could not be found. Jun 23 22:41:32.304877 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:41:32.304877 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:41:32.304877 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:41:32.304877 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:41:32.304877 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:41:32.304877 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:41:32.304877 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:41:32.304877 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:41:32.304877 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b could not be found. Jun 23 22:41:32.304877 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:41:32.306276 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-4bae012a-6d7a-4ebf-9b7a-50d9c7b0ad4d tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Returning 404 to user: Instance 05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b could not be found. {{(pid=124357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:41:32.306276 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-4bae012a-6d7a-4ebf-9b7a-50d9c7b0ad4d tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b" status: 404 len: 111 microversion: 2.1 time: 0.030655 Jun 23 22:41:32.306276 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 292/559] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:32 2022] GET /compute/v2.1/servers/05cfbf08-fa7c-4c9e-ac4b-7a94984ffa1b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:41:32.311530 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-0655bfcc-22de-4ea5-9bcc-7798c0c904a6 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '.version_select at 0x7fb71a002160>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:32.329019 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-0655bfcc-22de-4ea5-9bcc-7798c0c904a6 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1197272065" status: 202 len: 0 microversion: 2.1 time: 0.021257 Jun 23 22:41:32.329590 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 268/560] 10.222.0.43 () {58 vars in 1220 bytes} [Thu Jun 23 22:41:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1197272065 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:41:32.816238 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-fe8979ec-a1f1-4314-bb59-ee80f2bef5f0 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:32.817243 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-fe8979ec-a1f1-4314-bb59-ee80f2bef5f0 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: e085b10f-a993-4e81-963d-0006a6431b67] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:32.823871 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fe8979ec-a1f1-4314-bb59-ee80f2bef5f0 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:32.824307 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fe8979ec-a1f1-4314-bb59-ee80f2bef5f0 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:32.825060 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fe8979ec-a1f1-4314-bb59-ee80f2bef5f0 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:32.825486 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fe8979ec-a1f1-4314-bb59-ee80f2bef5f0 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:32.854770 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-fe8979ec-a1f1-4314-bb59-ee80f2bef5f0 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042507 Jun 23 22:41:32.855402 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 293/561] 10.222.0.43 () {58 vars in 1301 bytes} [Thu Jun 23 22:41:32 2022] GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 22:41:32.920069 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-21d50ce1-d8c0-4ae2-b106-62f0f0a569b8 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:32.920564 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-21d50ce1-d8c0-4ae2-b106-62f0f0a569b8 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: e085b10f-a993-4e81-963d-0006a6431b67] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:32.926509 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-21d50ce1-d8c0-4ae2-b106-62f0f0a569b8 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:32.926992 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-21d50ce1-d8c0-4ae2-b106-62f0f0a569b8 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:32.927766 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-21d50ce1-d8c0-4ae2-b106-62f0f0a569b8 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:32.928357 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-21d50ce1-d8c0-4ae2-b106-62f0f0a569b8 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:32.958760 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-21d50ce1-d8c0-4ae2-b106-62f0f0a569b8 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: e085b10f-a993-4e81-963d-0006a6431b67] Going to try to terminate instance {{(pid=124358) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:41:33.035669 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-21d50ce1-d8c0-4ae2-b106-62f0f0a569b8 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67" status: 204 len: 0 microversion: 2.1 time: 0.119605 Jun 23 22:41:33.036260 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 269/562] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 23 22:41:32 2022] DELETE /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 22:41:33.047768 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-2a01dc76-cfec-4fef-8a85-7a688a536f03 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:33.048432 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-2a01dc76-cfec-4fef-8a85-7a688a536f03 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: e085b10f-a993-4e81-963d-0006a6431b67] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:33.054668 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2a01dc76-cfec-4fef-8a85-7a688a536f03 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:33.055204 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2a01dc76-cfec-4fef-8a85-7a688a536f03 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:33.055982 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2a01dc76-cfec-4fef-8a85-7a688a536f03 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:33.056974 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2a01dc76-cfec-4fef-8a85-7a688a536f03 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:33.191500 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-2a01dc76-cfec-4fef-8a85-7a688a536f03 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:33.199009 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-2a01dc76-cfec-4fef-8a85-7a688a536f03 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67" status: 200 len: 1682 microversion: 2.1 time: 0.158020 Jun 23 22:41:33.199569 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 294/563] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:33 2022] GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:34.216339 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-6de4cf9c-1237-4352-b21d-8064f5afb65d tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:34.217031 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-6de4cf9c-1237-4352-b21d-8064f5afb65d tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: e085b10f-a993-4e81-963d-0006a6431b67] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:34.223344 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6de4cf9c-1237-4352-b21d-8064f5afb65d tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:34.223784 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6de4cf9c-1237-4352-b21d-8064f5afb65d tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:34.224530 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6de4cf9c-1237-4352-b21d-8064f5afb65d tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:34.224950 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6de4cf9c-1237-4352-b21d-8064f5afb65d tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:34.354496 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-6de4cf9c-1237-4352-b21d-8064f5afb65d tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:34.362496 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-6de4cf9c-1237-4352-b21d-8064f5afb65d tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67" status: 200 len: 1682 microversion: 2.1 time: 0.150901 Jun 23 22:41:34.363085 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 270/564] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:34 2022] GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:35.216726 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-a8a9c449-03e5-493d-a41b-e4f41481e7c9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:35.217220 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-a8a9c449-03e5-493d-a41b-e4f41481e7c9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:35.223717 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a8a9c449-03e5-493d-a41b-e4f41481e7c9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:35.224166 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a8a9c449-03e5-493d-a41b-e4f41481e7c9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:35.224917 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a8a9c449-03e5-493d-a41b-e4f41481e7c9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:35.225346 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a8a9c449-03e5-493d-a41b-e4f41481e7c9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:35.250361 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-a8a9c449-03e5-493d-a41b-e4f41481e7c9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Going to try to terminate instance {{(pid=124357) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:41:35.327559 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-a8a9c449-03e5-493d-a41b-e4f41481e7c9 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "DELETE /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 204 len: 0 microversion: 2.1 time: 0.114734 Jun 23 22:41:35.328248 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 295/565] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 23 22:41:35 2022] DELETE /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 22:41:35.338294 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-402c94c0-c093-4513-9f2b-557801951846 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:35.339194 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-402c94c0-c093-4513-9f2b-557801951846 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:35.345741 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-402c94c0-c093-4513-9f2b-557801951846 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:35.346184 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-402c94c0-c093-4513-9f2b-557801951846 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:35.346977 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-402c94c0-c093-4513-9f2b-557801951846 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:35.347441 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-402c94c0-c093-4513-9f2b-557801951846 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:35.381014 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-604ed946-cca3-4f6e-b4f6-74bd5199b9b1 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:35.381632 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-604ed946-cca3-4f6e-b4f6-74bd5199b9b1 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: e085b10f-a993-4e81-963d-0006a6431b67] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:35.388653 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-604ed946-cca3-4f6e-b4f6-74bd5199b9b1 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:35.389093 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-604ed946-cca3-4f6e-b4f6-74bd5199b9b1 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:35.389863 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-604ed946-cca3-4f6e-b4f6-74bd5199b9b1 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:35.390290 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-604ed946-cca3-4f6e-b4f6-74bd5199b9b1 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:35.529836 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-402c94c0-c093-4513-9f2b-557801951846 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:35.537347 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-402c94c0-c093-4513-9f2b-557801951846 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1509 microversion: 2.1 time: 0.205077 Jun 23 22:41:35.537910 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 271/566] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:35 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1509 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:35.555670 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-604ed946-cca3-4f6e-b4f6-74bd5199b9b1 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:35.563391 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-604ed946-cca3-4f6e-b4f6-74bd5199b9b1 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67" status: 200 len: 1682 microversion: 2.1 time: 0.186735 Jun 23 22:41:35.563956 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 296/567] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:35 2022] GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67 => generated 1682 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:41:36.554794 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-dc14c210-0992-4899-bb0f-43c2bbceab1a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:36.555423 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-dc14c210-0992-4899-bb0f-43c2bbceab1a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:36.562056 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-dc14c210-0992-4899-bb0f-43c2bbceab1a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:36.562489 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-dc14c210-0992-4899-bb0f-43c2bbceab1a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:36.563270 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-dc14c210-0992-4899-bb0f-43c2bbceab1a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:36.563696 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-dc14c210-0992-4899-bb0f-43c2bbceab1a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:36.580941 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-3b6ea61d-8b52-4385-a94a-db3f43ceecd0 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:36.581555 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-3b6ea61d-8b52-4385-a94a-db3f43ceecd0 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: e085b10f-a993-4e81-963d-0006a6431b67] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:36.588565 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3b6ea61d-8b52-4385-a94a-db3f43ceecd0 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:36.589055 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3b6ea61d-8b52-4385-a94a-db3f43ceecd0 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:36.589827 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3b6ea61d-8b52-4385-a94a-db3f43ceecd0 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:36.590258 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3b6ea61d-8b52-4385-a94a-db3f43ceecd0 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:36.791906 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-dc14c210-0992-4899-bb0f-43c2bbceab1a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:36.797324 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-3b6ea61d-8b52-4385-a94a-db3f43ceecd0 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:36.799519 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-dc14c210-0992-4899-bb0f-43c2bbceab1a tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1509 microversion: 2.1 time: 0.248509 Jun 23 22:41:36.800098 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 272/568] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:36 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1509 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:36.804911 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-3b6ea61d-8b52-4385-a94a-db3f43ceecd0 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67" status: 200 len: 1682 microversion: 2.1 time: 0.227771 Jun 23 22:41:36.805462 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 297/569] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:36 2022] GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67 => generated 1682 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:41:37.816924 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-6e8d625a-b50f-47bc-a250-49f4dfa7aa52 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:37.817714 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-6e8d625a-b50f-47bc-a250-49f4dfa7aa52 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:37.823105 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-354781c8-2dce-4f41-bbc9-b12f7f3034a2 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:37.824067 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-354781c8-2dce-4f41-bbc9-b12f7f3034a2 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: e085b10f-a993-4e81-963d-0006a6431b67] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:37.825045 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6e8d625a-b50f-47bc-a250-49f4dfa7aa52 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:37.825495 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6e8d625a-b50f-47bc-a250-49f4dfa7aa52 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:37.826266 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6e8d625a-b50f-47bc-a250-49f4dfa7aa52 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:37.826696 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6e8d625a-b50f-47bc-a250-49f4dfa7aa52 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:37.831856 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-354781c8-2dce-4f41-bbc9-b12f7f3034a2 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:37.831856 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-354781c8-2dce-4f41-bbc9-b12f7f3034a2 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:37.831856 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-354781c8-2dce-4f41-bbc9-b12f7f3034a2 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:37.832168 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-354781c8-2dce-4f41-bbc9-b12f7f3034a2 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:38.024317 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-354781c8-2dce-4f41-bbc9-b12f7f3034a2 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:38.027586 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-6e8d625a-b50f-47bc-a250-49f4dfa7aa52 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:38.032290 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-354781c8-2dce-4f41-bbc9-b12f7f3034a2 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67" status: 200 len: 1682 microversion: 2.1 time: 0.213867 Jun 23 22:41:38.033482 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 298/570] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:37 2022] GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67 => generated 1682 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:38.035664 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-6e8d625a-b50f-47bc-a250-49f4dfa7aa52 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1509 microversion: 2.1 time: 0.222263 Jun 23 22:41:38.036130 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 273/571] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:37 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1509 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:41:39.051875 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-9fc47afc-58fa-49c8-b9a4-2ad807fd956b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:39.053660 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-9fc47afc-58fa-49c8-b9a4-2ad807fd956b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: e085b10f-a993-4e81-963d-0006a6431b67] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:39.055099 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-9250fa40-86b1-4b2d-8b7d-6a3338d087c8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:39.055810 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-9250fa40-86b1-4b2d-8b7d-6a3338d087c8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:39.066648 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9fc47afc-58fa-49c8-b9a4-2ad807fd956b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:39.067524 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9fc47afc-58fa-49c8-b9a4-2ad807fd956b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:39.068406 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9250fa40-86b1-4b2d-8b7d-6a3338d087c8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:39.068536 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9fc47afc-58fa-49c8-b9a4-2ad807fd956b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:39.068946 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9250fa40-86b1-4b2d-8b7d-6a3338d087c8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:39.069072 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9fc47afc-58fa-49c8-b9a4-2ad807fd956b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:39.069740 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9250fa40-86b1-4b2d-8b7d-6a3338d087c8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:39.070407 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9250fa40-86b1-4b2d-8b7d-6a3338d087c8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:39.174022 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-9fc47afc-58fa-49c8-b9a4-2ad807fd956b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:39.182349 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-9fc47afc-58fa-49c8-b9a4-2ad807fd956b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67" status: 200 len: 1614 microversion: 2.1 time: 0.134088 Jun 23 22:41:39.192028 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 299/572] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:39 2022] GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67 => generated 1614 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:39.578467 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [req-457531c9-6530-4151-9c52-f78e3f6e64f4 req-f9c9e9ec-e637-4c2b-951b-3df9ac32178d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e085b10f-a993-4e81-963d-0006a6431b67", "name": "network-vif-deleted", "tag": "249824e0-dfdc-4f82-b94a-8d07832fb74e"}]} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:41:39.592821 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-457531c9-6530-4151-9c52-f78e3f6e64f4 req-f9c9e9ec-e637-4c2b-951b-3df9ac32178d service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:39.593586 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-457531c9-6530-4151-9c52-f78e3f6e64f4 req-f9c9e9ec-e637-4c2b-951b-3df9ac32178d service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:39.617752 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.compute.server_external_events [req-457531c9-6530-4151-9c52-f78e3f6e64f4 req-f9c9e9ec-e637-4c2b-951b-3df9ac32178d service nova] Creating event network-vif-deleted:249824e0-dfdc-4f82-b94a-8d07832fb74e for instance e085b10f-a993-4e81-963d-0006a6431b67 on hv-cinder-84617 Jun 23 22:41:39.623894 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [req-457531c9-6530-4151-9c52-f78e3f6e64f4 req-f9c9e9ec-e637-4c2b-951b-3df9ac32178d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054456 Jun 23 22:41:39.624917 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 300/573] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:41:39.702721 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-9250fa40-86b1-4b2d-8b7d-6a3338d087c8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:39.712195 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-9250fa40-86b1-4b2d-8b7d-6a3338d087c8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 200 len: 1509 microversion: 2.1 time: 0.662545 Jun 23 22:41:39.713898 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 274/574] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:39 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 1509 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:40.202406 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-75fe02e3-9502-438f-aaf9-6669114be47e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:40.203370 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-75fe02e3-9502-438f-aaf9-6669114be47e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: e085b10f-a993-4e81-963d-0006a6431b67] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:40.220024 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-75fe02e3-9502-438f-aaf9-6669114be47e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:40.220548 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-75fe02e3-9502-438f-aaf9-6669114be47e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:40.221402 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-75fe02e3-9502-438f-aaf9-6669114be47e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:40.221910 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-75fe02e3-9502-438f-aaf9-6669114be47e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:40.240902 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.wsgi [None req-75fe02e3-9502-438f-aaf9-6669114be47e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] HTTP exception thrown: Instance e085b10f-a993-4e81-963d-0006a6431b67 could not be found. Jun 23 22:41:40.243118 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-75fe02e3-9502-438f-aaf9-6669114be47e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Request method failure captured: Jun 23 22:41:40.243118 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: request: GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67 HTTP/1.1 Jun 23 22:41:40.243118 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept: application/json Jun 23 22:41:40.243118 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept-Encoding: identity Jun 23 22:41:40.243118 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Connection: close Jun 23 22:41:40.243118 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Length: 0 Jun 23 22:41:40.243118 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Type: application/json Jun 23 22:41:40.243118 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Host: 10.222.0.43 Jun 23 22:41:40.243118 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Openstack-System-Scope: None Jun 23 22:41:40.243118 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: User-Agent: python-urllib3/1.26.9 Jun 23 22:41:40.243118 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Auth-Token: gAAAAABitOrWyDITCi2PmBTdDblZ-ZSwK9B2UK_lIIWOMJB9Z-7YhxsoOI1DrhAeUCIChTCXv2hii5VV1HcTnkYXbW5bgXE95MCdJVwhuPtEsdt8Afqc-N7hZn6zZkza9EI9jSK71KcKdXUQCp4unsH4J6JfPLYATxcY6NVUnHVlcszTDCqSUi0 Jun 23 22:41:40.243118 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Id: None Jun 23 22:41:40.243118 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Name: None Jun 23 22:41:40.243118 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Identity-Status: Confirmed Jun 23 22:41:40.243118 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Is-Admin-Project: True Jun 23 22:41:40.243118 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Id: default Jun 23 22:41:40.243118 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Name: Default Jun 23 22:41:40.243118 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Id: 2735e40fe2564a6d8a5cdc7c32b0b869 Jun 23 22:41:40.243118 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Name: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:41:40.243118 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Role: reader,member Jun 23 22:41:40.243118 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Roles: reader,member Jun 23 22:41:40.245959 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2735e40fe2564a6d8a5cdc7c32b0b869", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:41:40.245959 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:41:40.245959 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Id: 2735e40fe2564a6d8a5cdc7c32b0b869 Jun 23 22:41:40.245959 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:41:40.245959 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User: tempest-AttachVolumeNegativeTest-184787456-project Jun 23 22:41:40.245959 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Id: default Jun 23 22:41:40.245959 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Name: Default Jun 23 22:41:40.245959 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Id: 03486c7630314392b85271455d12aba2 Jun 23 22:41:40.245959 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Name: tempest-AttachVolumeNegativeTest-184787456-project Jun 23 22:41:40.245959 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: method: > Jun 23 22:41:40.245959 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: exception: Instance e085b10f-a993-4e81-963d-0006a6431b67 could not be found. Jun 23 22:41:40.245959 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: action_args: {'id': 'e085b10f-a993-4e81-963d-0006a6431b67'} Jun 23 22:41:40.247646 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:41:40.247646 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:41:40.247646 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:41:40.247646 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:41:40.247646 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:41:40.247646 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:41:40.247646 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:41:40.247646 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:41:40.247646 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:41:40.247646 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:41:40.247646 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e085b10f-a993-4e81-963d-0006a6431b67 could not be found. Jun 23 22:41:40.247646 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:41:40.247646 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:41:40.247646 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:41:40.247646 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:41:40.247646 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:41:40.247646 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:41:40.247646 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:41:40.247646 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:41:40.247646 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:41:40.249355 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:41:40.249355 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:41:40.249355 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:41:40.249355 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:41:40.249355 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:41:40.249355 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:41:40.249355 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:41:40.249355 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e085b10f-a993-4e81-963d-0006a6431b67 could not be found. Jun 23 22:41:40.249355 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:41:40.249355 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:41:40.249355 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:41:40.249355 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:41:40.249355 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:41:40.249355 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:41:40.249355 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:41:40.249355 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:41:40.249355 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e085b10f-a993-4e81-963d-0006a6431b67 could not be found. Jun 23 22:41:40.249355 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:41:40.250838 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-75fe02e3-9502-438f-aaf9-6669114be47e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Returning 404 to user: Instance e085b10f-a993-4e81-963d-0006a6431b67 could not be found. {{(pid=124357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:41:40.250838 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-75fe02e3-9502-438f-aaf9-6669114be47e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67" status: 404 len: 111 microversion: 2.1 time: 0.050489 Jun 23 22:41:40.250838 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 301/575] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:40 2022] GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:41:40.258012 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e8643eb2-69c9-4693-8265-69f3af3f5493 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '.version_select at 0x7fb719729e50>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:40.281011 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e8643eb2-69c9-4693-8265-69f3af3f5493 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1939627023" status: 202 len: 0 microversion: 2.1 time: 0.027966 Jun 23 22:41:40.281762 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 275/576] 10.222.0.43 () {58 vars in 1220 bytes} [Thu Jun 23 22:41:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1939627023 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:41:40.734727 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-c9b7e9ae-da91-4f20-9811-d16df2a503d2 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:40.736331 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-c9b7e9ae-da91-4f20-9811-d16df2a503d2 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: eda9f458-d54a-46b6-a86a-884bc9d95a64] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:40.746898 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c9b7e9ae-da91-4f20-9811-d16df2a503d2 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:40.747372 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c9b7e9ae-da91-4f20-9811-d16df2a503d2 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:40.748135 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c9b7e9ae-da91-4f20-9811-d16df2a503d2 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:40.748832 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c9b7e9ae-da91-4f20-9811-d16df2a503d2 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:40.768508 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.wsgi [None req-c9b7e9ae-da91-4f20-9811-d16df2a503d2 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] HTTP exception thrown: Instance eda9f458-d54a-46b6-a86a-884bc9d95a64 could not be found. Jun 23 22:41:40.770710 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-c9b7e9ae-da91-4f20-9811-d16df2a503d2 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Request method failure captured: Jun 23 22:41:40.770710 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: request: GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 HTTP/1.1 Jun 23 22:41:40.770710 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept: application/json Jun 23 22:41:40.770710 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept-Encoding: identity Jun 23 22:41:40.770710 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Connection: close Jun 23 22:41:40.770710 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Length: 0 Jun 23 22:41:40.770710 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Type: application/json Jun 23 22:41:40.770710 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Host: 10.222.0.43 Jun 23 22:41:40.770710 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Openstack-System-Scope: None Jun 23 22:41:40.770710 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: User-Agent: python-urllib3/1.26.9 Jun 23 22:41:40.770710 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Auth-Token: gAAAAABitOraLpi8Pvpi8Qc1Y4M-Pla8fum-8INT6fklVezA6HYJEy-_7LboWQXaqmKodYFNcJuBs2lqdl0aMvfex_YkVFYW6g3zGPxaMIBdBYAGSe9Z9h-akU9iV1MHzsT9eii0Id3pUsBpLUHlU69nBSDw0uRkdeq0OpdeT6mYb1v54X9To2I Jun 23 22:41:40.770710 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Id: None Jun 23 22:41:40.770710 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Name: None Jun 23 22:41:40.770710 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Identity-Status: Confirmed Jun 23 22:41:40.770710 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Is-Admin-Project: True Jun 23 22:41:40.770710 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Id: default Jun 23 22:41:40.770710 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Name: Default Jun 23 22:41:40.770710 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Id: 192d1c8d15ce462dbf10fc3b519ab253 Jun 23 22:41:40.770710 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-675175554 Jun 23 22:41:40.770710 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Role: reader,member Jun 23 22:41:40.770710 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Roles: reader,member Jun 23 22:41:40.772090 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/192d1c8d15ce462dbf10fc3b519ab253"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/192d1c8d15ce462dbf10fc3b519ab253"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_192d1c8d15ce462dbf10fc3b519ab253", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/192d1c8d15ce462dbf10fc3b519ab253"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:41:40.772090 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant: tempest-ServerRescueNegativeTestJSON-675175554 Jun 23 22:41:40.772090 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Id: 192d1c8d15ce462dbf10fc3b519ab253 Jun 23 22:41:40.772090 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-675175554 Jun 23 22:41:40.772090 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User: tempest-ServerRescueNegativeTestJSON-675175554-project Jun 23 22:41:40.772090 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Id: default Jun 23 22:41:40.772090 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Name: Default Jun 23 22:41:40.772090 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Id: dc246e144afc46698000f7f53ef6489e Jun 23 22:41:40.772090 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Name: tempest-ServerRescueNegativeTestJSON-675175554-project Jun 23 22:41:40.772090 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: method: > Jun 23 22:41:40.772090 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: exception: Instance eda9f458-d54a-46b6-a86a-884bc9d95a64 could not be found. Jun 23 22:41:40.772090 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: action_args: {'id': 'eda9f458-d54a-46b6-a86a-884bc9d95a64'} Jun 23 22:41:40.772914 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:41:40.772914 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:41:40.772914 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:41:40.772914 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:41:40.772914 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:41:40.772914 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:41:40.772914 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:41:40.772914 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:41:40.772914 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:41:40.772914 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:41:40.772914 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eda9f458-d54a-46b6-a86a-884bc9d95a64 could not be found. Jun 23 22:41:40.772914 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:41:40.772914 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:41:40.772914 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:41:40.772914 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:41:40.772914 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:41:40.772914 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:41:40.772914 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:41:40.772914 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:41:40.772914 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:41:40.774088 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:41:40.774088 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:41:40.774088 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:41:40.774088 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:41:40.774088 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:41:40.774088 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:41:40.774088 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:41:40.774088 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eda9f458-d54a-46b6-a86a-884bc9d95a64 could not be found. Jun 23 22:41:40.774088 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:41:40.774088 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:41:40.774088 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:41:40.774088 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:41:40.774088 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:41:40.774088 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:41:40.774088 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:41:40.774088 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:41:40.774088 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eda9f458-d54a-46b6-a86a-884bc9d95a64 could not be found. Jun 23 22:41:40.774088 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:41:40.775256 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-c9b7e9ae-da91-4f20-9811-d16df2a503d2 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Returning 404 to user: Instance eda9f458-d54a-46b6-a86a-884bc9d95a64 could not be found. {{(pid=124357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:41:40.775256 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-c9b7e9ae-da91-4f20-9811-d16df2a503d2 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64" status: 404 len: 111 microversion: 2.1 time: 0.045829 Jun 23 22:41:40.775256 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 302/577] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:40 2022] GET /compute/v2.1/servers/eda9f458-d54a-46b6-a86a-884bc9d95a64 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:41:40.783942 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-5502b3c1-64b0-4cf9-b14d-2090c8194fb8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:40.784538 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-5502b3c1-64b0-4cf9-b14d-2090c8194fb8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:40.792041 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5502b3c1-64b0-4cf9-b14d-2090c8194fb8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:40.792480 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5502b3c1-64b0-4cf9-b14d-2090c8194fb8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:40.793262 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5502b3c1-64b0-4cf9-b14d-2090c8194fb8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:40.793742 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5502b3c1-64b0-4cf9-b14d-2090c8194fb8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:40.819231 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-5502b3c1-64b0-4cf9-b14d-2090c8194fb8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4] Going to try to terminate instance {{(pid=124358) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:41:40.927194 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-5502b3c1-64b0-4cf9-b14d-2090c8194fb8 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "DELETE /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4" status: 204 len: 0 microversion: 2.1 time: 0.146794 Jun 23 22:41:40.928727 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 276/578] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 23 22:41:40 2022] DELETE /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 22:41:40.939348 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-215fa13e-5160-45eb-a622-7ef85a79edc1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:40.940764 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-215fa13e-5160-45eb-a622-7ef85a79edc1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:40.951820 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-215fa13e-5160-45eb-a622-7ef85a79edc1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:40.952882 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-215fa13e-5160-45eb-a622-7ef85a79edc1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:40.954578 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-215fa13e-5160-45eb-a622-7ef85a79edc1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:40.955464 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-215fa13e-5160-45eb-a622-7ef85a79edc1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:40.985581 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-10edaf94-65e4-4786-9ce1-1bd6dbbef9c3 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Action: 'create', calling method: .version_select at 0x7fb719f6fdc0>, body: {"keypair": {"name": "tempest-keypair-450586368", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5sSAutoG9DQ6iIx49f8mfPWQdhMfKIK7ALFsgBu9dmJCFFULP8f4qPSIdGN9ZjS+SExoKshAaQHYRw1kIlANYTuyimZt1RnGa/Lh5yi21xUTHGSXkq9ByFKs/z0xb7LQ=="}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:41:41.005284 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-10edaf94-65e4-4786-9ce1-1bd6dbbef9c3 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Getting quotas for project 2735e40fe2564a6d8a5cdc7c32b0b869. Resources: {'key_pairs'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:41:41.010190 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-10edaf94-65e4-4786-9ce1-1bd6dbbef9c3 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Getting quotas for user 03486c7630314392b85271455d12aba2 and project 2735e40fe2564a6d8a5cdc7c32b0b869. Resources: {'key_pairs'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:41:41.044193 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-10edaf94-65e4-4786-9ce1-1bd6dbbef9c3 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.062580 Jun 23 22:41:41.049861 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 277/579] 10.222.0.43 () {60 vars in 1158 bytes} [Thu Jun 23 22:41:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:41:41.125079 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-215fa13e-5160-45eb-a622-7ef85a79edc1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:41.130511 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:41:41.137393 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-215fa13e-5160-45eb-a622-7ef85a79edc1 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4" status: 200 len: 1522 microversion: 2.1 time: 0.204558 Jun 23 22:41:41.138220 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 303/580] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:40 2022] GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:41.648917 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-bbb83183-2596-4edb-b036-4453b145f577 req-97292fc8-acbc-44fd-9aad-aa817513a3b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eda9f458-d54a-46b6-a86a-884bc9d95a64", "name": "network-vif-deleted", "tag": "db6ca92f-4e18-420e-8910-cb6285fa5c3d"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:41:41.656879 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-bbb83183-2596-4edb-b036-4453b145f577 req-97292fc8-acbc-44fd-9aad-aa817513a3b7 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:41.657320 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-bbb83183-2596-4edb-b036-4453b145f577 req-97292fc8-acbc-44fd-9aad-aa817513a3b7 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:41.669145 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-bbb83183-2596-4edb-b036-4453b145f577 req-97292fc8-acbc-44fd-9aad-aa817513a3b7 service nova] Creating event network-vif-deleted:db6ca92f-4e18-420e-8910-cb6285fa5c3d for instance eda9f458-d54a-46b6-a86a-884bc9d95a64 on hv-cinder-84617 Jun 23 22:41:41.673893 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-bbb83183-2596-4edb-b036-4453b145f577 req-97292fc8-acbc-44fd-9aad-aa817513a3b7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029362 Jun 23 22:41:41.674494 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 278/581] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:41:42.156547 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-d18b1311-de30-457f-ba10-965c01010223 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:42.157157 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-d18b1311-de30-457f-ba10-965c01010223 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:42.164977 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d18b1311-de30-457f-ba10-965c01010223 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:42.165417 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d18b1311-de30-457f-ba10-965c01010223 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:42.166417 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d18b1311-de30-457f-ba10-965c01010223 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:42.166994 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d18b1311-de30-457f-ba10-965c01010223 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:42.385834 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-d18b1311-de30-457f-ba10-965c01010223 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:42.393854 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-d18b1311-de30-457f-ba10-965c01010223 tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4" status: 200 len: 1522 microversion: 2.1 time: 0.241160 Jun 23 22:41:42.394430 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 304/582] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:42 2022] GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:42.436632 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-8c45d19f-243a-4bc5-a92d-2df3e6fe1f27 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-712359704", "imageRef": "ac7d441e-2ac8-49ad-9dc5-3c55bd4b4f8b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e8170354-014e-4823-a204-b43deead6b56"}], "security_groups": [{"name": "tempest-securitygroup--235327642"}], "key_name": "tempest-keypair-450586368", "user_data": "}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:41:42.542158 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.network.neutron [None req-8c45d19f-243a-4bc5-a92d-2df3e6fe1f27 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] validate_networks() for [('e8170354-014e-4823-a204-b43deead6b56', None, None, None, None, None)] {{(pid=124358) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:41:42.972314 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-8c45d19f-243a-4bc5-a92d-2df3e6fe1f27 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Flavor limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:41:42.972875 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-8c45d19f-243a-4bc5-a92d-2df3e6fe1f27 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Image limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:41:42.973192 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-8c45d19f-243a-4bc5-a92d-2df3e6fe1f27 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Flavor pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:41:42.973615 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-8c45d19f-243a-4bc5-a92d-2df3e6fe1f27 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Image pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:41:42.974023 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-8c45d19f-243a-4bc5-a92d-2df3e6fe1f27 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:41:42.983392 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8c45d19f-243a-4bc5-a92d-2df3e6fe1f27 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:42.983968 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8c45d19f-243a-4bc5-a92d-2df3e6fe1f27 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:42.984873 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8c45d19f-243a-4bc5-a92d-2df3e6fe1f27 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:42.985315 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8c45d19f-243a-4bc5-a92d-2df3e6fe1f27 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:43.002343 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-8c45d19f-243a-4bc5-a92d-2df3e6fe1f27 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Getting quotas for project 2735e40fe2564a6d8a5cdc7c32b0b869. Resources: {'instances', 'cores', 'ram'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:41:43.006406 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-8c45d19f-243a-4bc5-a92d-2df3e6fe1f27 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Getting quotas for user 03486c7630314392b85271455d12aba2 and project 2735e40fe2564a6d8a5cdc7c32b0b869. Resources: {'instances', 'cores', 'ram'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:41:43.017762 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-8c45d19f-243a-4bc5-a92d-2df3e6fe1f27 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Going to run 1 instances... {{(pid=124358) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:41:43.020119 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-8c45d19f-243a-4bc5-a92d-2df3e6fe1f27 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ac7d441e-2ac8-49ad-9dc5-3c55bd4b4f8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:41:43.068944 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-8c45d19f-243a-4bc5-a92d-2df3e6fe1f27 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.637051 Jun 23 22:41:43.070269 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 279/583] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Jun 23 22:41:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 22:41:43.085510 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-5ffcae3a-eefc-4ec4-b223-049ca5d79980 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:43.086167 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-5ffcae3a-eefc-4ec4-b223-049ca5d79980 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:43.145151 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-5ffcae3a-eefc-4ec4-b223-049ca5d79980 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:43.152584 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-5ffcae3a-eefc-4ec4-b223-049ca5d79980 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4" status: 200 len: 1240 microversion: 2.1 time: 0.072773 Jun 23 22:41:43.153787 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 305/584] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:43 2022] GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 => generated 1240 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:43.415583 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c2d76b5f-2a54-4471-b7f7-0291b0b13efd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:43.416855 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c2d76b5f-2a54-4471-b7f7-0291b0b13efd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:43.425639 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c2d76b5f-2a54-4471-b7f7-0291b0b13efd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:43.426438 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c2d76b5f-2a54-4471-b7f7-0291b0b13efd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:43.426837 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c2d76b5f-2a54-4471-b7f7-0291b0b13efd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:43.427303 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c2d76b5f-2a54-4471-b7f7-0291b0b13efd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:43.591351 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c2d76b5f-2a54-4471-b7f7-0291b0b13efd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:43.599213 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c2d76b5f-2a54-4471-b7f7-0291b0b13efd tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4" status: 200 len: 1522 microversion: 2.1 time: 0.188052 Jun 23 22:41:43.599768 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 280/585] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:43 2022] GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:44.174410 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-512df4ac-4d73-4747-9700-0ec0610f125b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:44.175483 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-512df4ac-4d73-4747-9700-0ec0610f125b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:44.187213 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-512df4ac-4d73-4747-9700-0ec0610f125b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:44.187848 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-512df4ac-4d73-4747-9700-0ec0610f125b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:44.189619 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-512df4ac-4d73-4747-9700-0ec0610f125b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:44.190679 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-512df4ac-4d73-4747-9700-0ec0610f125b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:44.283654 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-512df4ac-4d73-4747-9700-0ec0610f125b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:44.300008 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-512df4ac-4d73-4747-9700-0ec0610f125b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4" status: 200 len: 1292 microversion: 2.1 time: 0.132697 Jun 23 22:41:44.301133 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 306/586] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:44 2022] GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 => generated 1292 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:44.616829 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-11abf60f-f659-4aee-8b8b-f9713d3eadae tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:44.617442 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-11abf60f-f659-4aee-8b8b-f9713d3eadae tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:44.625019 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-11abf60f-f659-4aee-8b8b-f9713d3eadae tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:44.625598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-11abf60f-f659-4aee-8b8b-f9713d3eadae tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:44.626263 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-11abf60f-f659-4aee-8b8b-f9713d3eadae tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:44.626698 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-11abf60f-f659-4aee-8b8b-f9713d3eadae tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:44.997445 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-11abf60f-f659-4aee-8b8b-f9713d3eadae tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc246e144afc46698000f7f53ef6489e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '192d1c8d15ce462dbf10fc3b519ab253', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:45.005218 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-11abf60f-f659-4aee-8b8b-f9713d3eadae tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4" status: 200 len: 1522 microversion: 2.1 time: 0.392478 Jun 23 22:41:45.005797 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 281/587] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:44 2022] GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 => generated 1522 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:45.317527 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-463970d4-a5e2-4fdc-ab0a-d934ad404d84 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:45.318155 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-463970d4-a5e2-4fdc-ab0a-d934ad404d84 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:45.324820 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-463970d4-a5e2-4fdc-ab0a-d934ad404d84 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:45.325255 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-463970d4-a5e2-4fdc-ab0a-d934ad404d84 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:45.326011 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-463970d4-a5e2-4fdc-ab0a-d934ad404d84 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:45.326436 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-463970d4-a5e2-4fdc-ab0a-d934ad404d84 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:45.363465 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-f5144be4-d317-49b1-88a2-68bf26ec739f req-db7f6e83-2302-4aa5-b93b-b77941873ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "903f0ba6-4cc4-4533-8e70-b8f58c13d4c4", "name": "network-vif-deleted", "tag": "79ccfbc8-28e4-4313-8f45-8c693924dbde"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:41:45.373435 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-f5144be4-d317-49b1-88a2-68bf26ec739f req-db7f6e83-2302-4aa5-b93b-b77941873ae1 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:45.373872 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-f5144be4-d317-49b1-88a2-68bf26ec739f req-db7f6e83-2302-4aa5-b93b-b77941873ae1 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:45.387412 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-f5144be4-d317-49b1-88a2-68bf26ec739f req-db7f6e83-2302-4aa5-b93b-b77941873ae1 service nova] Creating event network-vif-deleted:79ccfbc8-28e4-4313-8f45-8c693924dbde for instance 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 on hv-cinder-84617 Jun 23 22:41:45.392719 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-f5144be4-d317-49b1-88a2-68bf26ec739f req-db7f6e83-2302-4aa5-b93b-b77941873ae1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035707 Jun 23 22:41:45.393322 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 282/588] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:41:45.414909 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-463970d4-a5e2-4fdc-ab0a-d934ad404d84 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:45.424630 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-463970d4-a5e2-4fdc-ab0a-d934ad404d84 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4" status: 200 len: 1298 microversion: 2.1 time: 0.110799 Jun 23 22:41:45.425556 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 307/589] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:45 2022] GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 => generated 1298 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:46.023702 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-7d5e31e8-5e32-4f17-80e3-b2aa1ba3f2ba tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:46.024761 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-7d5e31e8-5e32-4f17-80e3-b2aa1ba3f2ba tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] [instance: 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:46.033594 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7d5e31e8-5e32-4f17-80e3-b2aa1ba3f2ba tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:46.034047 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7d5e31e8-5e32-4f17-80e3-b2aa1ba3f2ba tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:46.034830 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7d5e31e8-5e32-4f17-80e3-b2aa1ba3f2ba tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:46.035891 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7d5e31e8-5e32-4f17-80e3-b2aa1ba3f2ba tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:46.041127 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:41:46.053772 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-7d5e31e8-5e32-4f17-80e3-b2aa1ba3f2ba tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] HTTP exception thrown: Instance 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 could not be found. Jun 23 22:41:46.055733 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-7d5e31e8-5e32-4f17-80e3-b2aa1ba3f2ba tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Request method failure captured: Jun 23 22:41:46.055733 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: request: GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 HTTP/1.1 Jun 23 22:41:46.055733 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept: application/json Jun 23 22:41:46.055733 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Jun 23 22:41:46.055733 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Connection: close Jun 23 22:41:46.055733 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Length: 0 Jun 23 22:41:46.055733 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Type: application/json Jun 23 22:41:46.055733 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Host: 10.222.0.43 Jun 23 22:41:46.055733 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Jun 23 22:41:46.055733 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.9 Jun 23 22:41:46.055733 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABitOraLpi8Pvpi8Qc1Y4M-Pla8fum-8INT6fklVezA6HYJEy-_7LboWQXaqmKodYFNcJuBs2lqdl0aMvfex_YkVFYW6g3zGPxaMIBdBYAGSe9Z9h-akU9iV1MHzsT9eii0Id3pUsBpLUHlU69nBSDw0uRkdeq0OpdeT6mYb1v54X9To2I Jun 23 22:41:46.055733 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Jun 23 22:41:46.055733 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Jun 23 22:41:46.055733 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Jun 23 22:41:46.055733 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Jun 23 22:41:46.055733 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Jun 23 22:41:46.055733 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Jun 23 22:41:46.055733 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Id: 192d1c8d15ce462dbf10fc3b519ab253 Jun 23 22:41:46.055733 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-675175554 Jun 23 22:41:46.055733 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Role: reader,member Jun 23 22:41:46.055733 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Roles: reader,member Jun 23 22:41:46.057988 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/192d1c8d15ce462dbf10fc3b519ab253"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/192d1c8d15ce462dbf10fc3b519ab253"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_192d1c8d15ce462dbf10fc3b519ab253", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/192d1c8d15ce462dbf10fc3b519ab253"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:41:46.057988 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-ServerRescueNegativeTestJSON-675175554 Jun 23 22:41:46.057988 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Id: 192d1c8d15ce462dbf10fc3b519ab253 Jun 23 22:41:46.057988 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-675175554 Jun 23 22:41:46.057988 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User: tempest-ServerRescueNegativeTestJSON-675175554-project Jun 23 22:41:46.057988 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Jun 23 22:41:46.057988 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Jun 23 22:41:46.057988 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Id: dc246e144afc46698000f7f53ef6489e Jun 23 22:41:46.057988 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-ServerRescueNegativeTestJSON-675175554-project Jun 23 22:41:46.057988 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: method: > Jun 23 22:41:46.057988 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: exception: Instance 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 could not be found. Jun 23 22:41:46.057988 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: action_args: {'id': '903f0ba6-4cc4-4533-8e70-b8f58c13d4c4'} Jun 23 22:41:46.058864 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:41:46.058864 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:41:46.058864 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:41:46.058864 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:41:46.058864 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:41:46.058864 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:41:46.058864 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:41:46.058864 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:41:46.058864 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:41:46.058864 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:41:46.058864 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 could not be found. Jun 23 22:41:46.058864 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:41:46.058864 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:41:46.058864 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:41:46.058864 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:41:46.058864 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:41:46.058864 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:41:46.058864 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:41:46.058864 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:41:46.058864 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:41:46.060313 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:41:46.060313 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:41:46.060313 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:41:46.060313 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:41:46.060313 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:41:46.060313 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:41:46.060313 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:41:46.060313 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 could not be found. Jun 23 22:41:46.060313 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:41:46.060313 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:41:46.060313 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:41:46.060313 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:41:46.060313 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:41:46.060313 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:41:46.060313 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:41:46.060313 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:41:46.060313 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 could not be found. Jun 23 22:41:46.060313 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:41:46.061664 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-7d5e31e8-5e32-4f17-80e3-b2aa1ba3f2ba tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] Returning 404 to user: Instance 903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:41:46.061664 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-7d5e31e8-5e32-4f17-80e3-b2aa1ba3f2ba tempest-ServerRescueNegativeTestJSON-675175554 tempest-ServerRescueNegativeTestJSON-675175554-project] 10.222.0.43 "GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4" status: 404 len: 111 microversion: 2.1 time: 0.038517 Jun 23 22:41:46.061664 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 283/590] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:46 2022] GET /compute/v2.1/servers/903f0ba6-4cc4-4533-8e70-b8f58c13d4c4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:41:46.443934 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-d76c8a96-bd52-4cd2-9285-eec9a1734b6e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:46.445323 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-d76c8a96-bd52-4cd2-9285-eec9a1734b6e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:46.452821 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d76c8a96-bd52-4cd2-9285-eec9a1734b6e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:46.453595 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d76c8a96-bd52-4cd2-9285-eec9a1734b6e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:46.454347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d76c8a96-bd52-4cd2-9285-eec9a1734b6e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:46.454776 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d76c8a96-bd52-4cd2-9285-eec9a1734b6e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:46.673710 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-d76c8a96-bd52-4cd2-9285-eec9a1734b6e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:46.692610 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-d76c8a96-bd52-4cd2-9285-eec9a1734b6e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4" status: 200 len: 1365 microversion: 2.1 time: 0.252543 Jun 23 22:41:46.698106 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 308/591] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:46 2022] GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 => generated 1365 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:47.419392 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-57fd6164-e3ee-4ef3-8921-a308918ab94e req-1db34543-0038-4431-abe7-1f7ebe85aba3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4", "tag": "f62d6650-e1ce-4156-9949-4d5a16040e59"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:41:47.432184 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-57fd6164-e3ee-4ef3-8921-a308918ab94e req-1db34543-0038-4431-abe7-1f7ebe85aba3 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:47.432622 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-57fd6164-e3ee-4ef3-8921-a308918ab94e req-1db34543-0038-4431-abe7-1f7ebe85aba3 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:47.448668 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-57fd6164-e3ee-4ef3-8921-a308918ab94e req-1db34543-0038-4431-abe7-1f7ebe85aba3 service nova] Creating event network-changed:f62d6650-e1ce-4156-9949-4d5a16040e59 for instance ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 on hv-cinder-84617 Jun 23 22:41:47.453740 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-57fd6164-e3ee-4ef3-8921-a308918ab94e req-1db34543-0038-4431-abe7-1f7ebe85aba3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038764 Jun 23 22:41:47.454345 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 284/592] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:41:47.709869 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-1aca2ef3-6d65-473d-a400-9913325708f3 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:47.710487 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-1aca2ef3-6d65-473d-a400-9913325708f3 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:47.718365 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1aca2ef3-6d65-473d-a400-9913325708f3 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:47.718812 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1aca2ef3-6d65-473d-a400-9913325708f3 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:47.719628 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1aca2ef3-6d65-473d-a400-9913325708f3 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:47.720057 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1aca2ef3-6d65-473d-a400-9913325708f3 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:47.861576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-1aca2ef3-6d65-473d-a400-9913325708f3 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:47.869048 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-1aca2ef3-6d65-473d-a400-9913325708f3 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4" status: 200 len: 1365 microversion: 2.1 time: 0.163214 Jun 23 22:41:47.869621 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 309/593] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:47 2022] GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:48.894484 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-9cede9b7-d4f7-420e-90b8-01f1a47d16d3 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:48.895252 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-9cede9b7-d4f7-420e-90b8-01f1a47d16d3 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:48.903822 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9cede9b7-d4f7-420e-90b8-01f1a47d16d3 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:48.904297 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9cede9b7-d4f7-420e-90b8-01f1a47d16d3 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:48.905650 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9cede9b7-d4f7-420e-90b8-01f1a47d16d3 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:48.906129 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9cede9b7-d4f7-420e-90b8-01f1a47d16d3 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:49.150955 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-9cede9b7-d4f7-420e-90b8-01f1a47d16d3 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:49.160055 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-9cede9b7-d4f7-420e-90b8-01f1a47d16d3 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4" status: 200 len: 1365 microversion: 2.1 time: 0.276323 Jun 23 22:41:49.161183 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 285/594] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:48 2022] GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 => generated 1365 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:49.216636 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-1e2c8cb4-908f-42b6-a6da-011a5a153a5e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:49.217522 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-1e2c8cb4-908f-42b6-a6da-011a5a153a5e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: b1da69bd-51f5-4223-b7aa-652d2636f36b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:49.225264 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1e2c8cb4-908f-42b6-a6da-011a5a153a5e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:49.229588 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1e2c8cb4-908f-42b6-a6da-011a5a153a5e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:49.230603 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1e2c8cb4-908f-42b6-a6da-011a5a153a5e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:49.231280 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1e2c8cb4-908f-42b6-a6da-011a5a153a5e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:49.261000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-1e2c8cb4-908f-42b6-a6da-011a5a153a5e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: b1da69bd-51f5-4223-b7aa-652d2636f36b] Going to try to terminate instance {{(pid=124357) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:41:49.361354 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-1e2c8cb4-908f-42b6-a6da-011a5a153a5e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b" status: 204 len: 0 microversion: 2.1 time: 0.149126 Jun 23 22:41:49.362313 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 310/595] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 23 22:41:49 2022] DELETE /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 22:41:49.371969 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-580399e4-484a-4676-b19c-92718f6fa695 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:49.372589 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-580399e4-484a-4676-b19c-92718f6fa695 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: b1da69bd-51f5-4223-b7aa-652d2636f36b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:49.379594 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-580399e4-484a-4676-b19c-92718f6fa695 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:49.380240 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-580399e4-484a-4676-b19c-92718f6fa695 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:49.381184 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-580399e4-484a-4676-b19c-92718f6fa695 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:49.381777 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-580399e4-484a-4676-b19c-92718f6fa695 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:49.560053 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-580399e4-484a-4676-b19c-92718f6fa695 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:49.574597 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-580399e4-484a-4676-b19c-92718f6fa695 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b" status: 200 len: 1576 microversion: 2.1 time: 0.207942 Jun 23 22:41:49.590052 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 286/596] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:49 2022] GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b => generated 1576 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:41:50.179071 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-64065adc-1d52-4ebd-9243-65a55c9b8011 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:50.179992 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-64065adc-1d52-4ebd-9243-65a55c9b8011 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:50.189049 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-64065adc-1d52-4ebd-9243-65a55c9b8011 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:50.189567 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-64065adc-1d52-4ebd-9243-65a55c9b8011 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:50.190345 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-64065adc-1d52-4ebd-9243-65a55c9b8011 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:50.190782 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-64065adc-1d52-4ebd-9243-65a55c9b8011 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:50.343342 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-64065adc-1d52-4ebd-9243-65a55c9b8011 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:50.351423 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-64065adc-1d52-4ebd-9243-65a55c9b8011 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4" status: 200 len: 1365 microversion: 2.1 time: 0.176580 Jun 23 22:41:50.352072 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 311/597] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:50 2022] GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:41:50.594072 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-3117521a-c74c-4a81-a8ae-de1e3927cadb tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:50.594695 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-3117521a-c74c-4a81-a8ae-de1e3927cadb tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: b1da69bd-51f5-4223-b7aa-652d2636f36b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:50.601160 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3117521a-c74c-4a81-a8ae-de1e3927cadb tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:50.601601 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3117521a-c74c-4a81-a8ae-de1e3927cadb tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:50.602351 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3117521a-c74c-4a81-a8ae-de1e3927cadb tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:50.602777 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3117521a-c74c-4a81-a8ae-de1e3927cadb tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:50.738209 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-3117521a-c74c-4a81-a8ae-de1e3927cadb tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:50.747738 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-3117521a-c74c-4a81-a8ae-de1e3927cadb tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b" status: 200 len: 1576 microversion: 2.1 time: 0.157595 Jun 23 22:41:50.748321 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 287/598] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:50 2022] GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:51.369869 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-9b6a24fc-a135-4e3d-bd88-7beab19ca4c6 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:51.370619 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-9b6a24fc-a135-4e3d-bd88-7beab19ca4c6 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:51.376885 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9b6a24fc-a135-4e3d-bd88-7beab19ca4c6 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:51.377637 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9b6a24fc-a135-4e3d-bd88-7beab19ca4c6 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:51.378081 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9b6a24fc-a135-4e3d-bd88-7beab19ca4c6 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:51.378516 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9b6a24fc-a135-4e3d-bd88-7beab19ca4c6 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:51.742249 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-9b6a24fc-a135-4e3d-bd88-7beab19ca4c6 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:51.752412 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-9b6a24fc-a135-4e3d-bd88-7beab19ca4c6 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4" status: 200 len: 1365 microversion: 2.1 time: 0.387109 Jun 23 22:41:51.753414 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 312/599] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:51 2022] GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 => generated 1365 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:41:51.768797 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-62c5fa54-8526-4d14-be79-eb85f1b6e0c7 req-0f3b1821-777f-471b-84b7-092dbedb2cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4", "name": "network-vif-plugged", "status": "completed", "tag": "f62d6650-e1ce-4156-9949-4d5a16040e59"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:41:51.776600 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-e090f920-68ae-4f3a-8b61-d76c1906e996 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:51.777225 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-e090f920-68ae-4f3a-8b61-d76c1906e996 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: b1da69bd-51f5-4223-b7aa-652d2636f36b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:51.777862 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-62c5fa54-8526-4d14-be79-eb85f1b6e0c7 req-0f3b1821-777f-471b-84b7-092dbedb2cc8 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:51.778299 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-62c5fa54-8526-4d14-be79-eb85f1b6e0c7 req-0f3b1821-777f-471b-84b7-092dbedb2cc8 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:51.783840 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-e090f920-68ae-4f3a-8b61-d76c1906e996 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:51.784869 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-e090f920-68ae-4f3a-8b61-d76c1906e996 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:51.785656 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-e090f920-68ae-4f3a-8b61-d76c1906e996 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:51.786064 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-e090f920-68ae-4f3a-8b61-d76c1906e996 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:51.789605 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-62c5fa54-8526-4d14-be79-eb85f1b6e0c7 req-0f3b1821-777f-471b-84b7-092dbedb2cc8 service nova] Creating event network-vif-plugged:f62d6650-e1ce-4156-9949-4d5a16040e59 for instance ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 on hv-cinder-84617 Jun 23 22:41:51.796042 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-62c5fa54-8526-4d14-be79-eb85f1b6e0c7 req-0f3b1821-777f-471b-84b7-092dbedb2cc8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171485 Jun 23 22:41:51.797165 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 288/600] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:41:52.142881 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-e090f920-68ae-4f3a-8b61-d76c1906e996 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:52.155779 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-e090f920-68ae-4f3a-8b61-d76c1906e996 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b" status: 200 len: 1576 microversion: 2.1 time: 0.383246 Jun 23 22:41:52.168457 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 313/601] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:51 2022] GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b => generated 1576 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:52.648368 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-6a606ecf-2028-4236-9a5b-b906df8fd11f req-32219121-7c25-4b6c-9f7c-6ead79119517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1da69bd-51f5-4223-b7aa-652d2636f36b", "name": "network-vif-deleted", "tag": "9d8e2a40-5fc3-49a9-bca3-734e662a68dc"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:41:52.659161 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-6a606ecf-2028-4236-9a5b-b906df8fd11f req-32219121-7c25-4b6c-9f7c-6ead79119517 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:52.659977 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-6a606ecf-2028-4236-9a5b-b906df8fd11f req-32219121-7c25-4b6c-9f7c-6ead79119517 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:52.672244 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-6a606ecf-2028-4236-9a5b-b906df8fd11f req-32219121-7c25-4b6c-9f7c-6ead79119517 service nova] Creating event network-vif-deleted:9d8e2a40-5fc3-49a9-bca3-734e662a68dc for instance b1da69bd-51f5-4223-b7aa-652d2636f36b on hv-cinder-84617 Jun 23 22:41:52.677420 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-6a606ecf-2028-4236-9a5b-b906df8fd11f req-32219121-7c25-4b6c-9f7c-6ead79119517 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033076 Jun 23 22:41:52.678277 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 289/602] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:41:52.770969 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-50f541f2-c952-4a88-8534-701478760e29 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:52.771923 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-50f541f2-c952-4a88-8534-701478760e29 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:52.785050 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-50f541f2-c952-4a88-8534-701478760e29 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:52.785882 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-50f541f2-c952-4a88-8534-701478760e29 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:52.787856 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-50f541f2-c952-4a88-8534-701478760e29 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:52.789582 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-50f541f2-c952-4a88-8534-701478760e29 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:52.980318 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-50f541f2-c952-4a88-8534-701478760e29 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:52.990469 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-50f541f2-c952-4a88-8534-701478760e29 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4" status: 200 len: 1365 microversion: 2.1 time: 0.224571 Jun 23 22:41:52.991487 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 314/603] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:52 2022] GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:53.173876 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=2 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:41:53.175343 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=10 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:41:53.180452 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-942418b2-3681-411a-ab3e-0d8a557e5b03 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:53.181989 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-942418b2-3681-411a-ab3e-0d8a557e5b03 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: b1da69bd-51f5-4223-b7aa-652d2636f36b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:53.191238 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-942418b2-3681-411a-ab3e-0d8a557e5b03 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:53.191688 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-942418b2-3681-411a-ab3e-0d8a557e5b03 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:53.192505 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-942418b2-3681-411a-ab3e-0d8a557e5b03 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:53.192948 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-942418b2-3681-411a-ab3e-0d8a557e5b03 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:53.275893 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-942418b2-3681-411a-ab3e-0d8a557e5b03 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:53.295653 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-942418b2-3681-411a-ab3e-0d8a557e5b03 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b" status: 200 len: 1224 microversion: 2.1 time: 0.119827 Jun 23 22:41:53.296530 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 290/604] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:53 2022] GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b => generated 1224 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:54.005247 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell0:SELECT=2 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:41:54.011244 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-5900d39e-c22d-4236-9341-8c7f1bc22d62 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:54.011863 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-5900d39e-c22d-4236-9341-8c7f1bc22d62 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:54.026604 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5900d39e-c22d-4236-9341-8c7f1bc22d62 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:54.027333 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5900d39e-c22d-4236-9341-8c7f1bc22d62 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:54.029468 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5900d39e-c22d-4236-9341-8c7f1bc22d62 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:54.030093 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5900d39e-c22d-4236-9341-8c7f1bc22d62 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:54.251585 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-5900d39e-c22d-4236-9341-8c7f1bc22d62 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:54.261483 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-5900d39e-c22d-4236-9341-8c7f1bc22d62 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4" status: 200 len: 1365 microversion: 2.1 time: 0.256820 Jun 23 22:41:54.262397 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 315/605] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:54 2022] GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 => generated 1365 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:54.313358 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-5e3d9aa2-8e5c-4a28-9e52-a4741982a3d3 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:54.314644 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-5e3d9aa2-8e5c-4a28-9e52-a4741982a3d3 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: b1da69bd-51f5-4223-b7aa-652d2636f36b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:54.333502 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5e3d9aa2-8e5c-4a28-9e52-a4741982a3d3 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:54.334104 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5e3d9aa2-8e5c-4a28-9e52-a4741982a3d3 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:54.335221 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5e3d9aa2-8e5c-4a28-9e52-a4741982a3d3 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:54.336293 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5e3d9aa2-8e5c-4a28-9e52-a4741982a3d3 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:54.392588 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5e3d9aa2-8e5c-4a28-9e52-a4741982a3d3 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:54.393266 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5e3d9aa2-8e5c-4a28-9e52-a4741982a3d3 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:54.393975 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.objects.instance [None req-5e3d9aa2-8e5c-4a28-9e52-a4741982a3d3 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lazy-loading 'fault' on Instance uuid b1da69bd-51f5-4223-b7aa-652d2636f36b {{(pid=124358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:41:54.456737 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-5e3d9aa2-8e5c-4a28-9e52-a4741982a3d3 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:54.470200 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-5e3d9aa2-8e5c-4a28-9e52-a4741982a3d3 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b" status: 200 len: 1229 microversion: 2.1 time: 0.160488 Jun 23 22:41:54.471164 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 291/606] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:54 2022] GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b => generated 1229 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:55.278748 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-22a1d777-8595-4342-ae4e-4a3784917622 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:55.280141 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-22a1d777-8595-4342-ae4e-4a3784917622 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:55.287211 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-22a1d777-8595-4342-ae4e-4a3784917622 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:55.287658 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-22a1d777-8595-4342-ae4e-4a3784917622 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:55.288576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-22a1d777-8595-4342-ae4e-4a3784917622 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:55.289017 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-22a1d777-8595-4342-ae4e-4a3784917622 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:55.437057 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-22a1d777-8595-4342-ae4e-4a3784917622 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:55.446390 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-22a1d777-8595-4342-ae4e-4a3784917622 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4" status: 200 len: 1555 microversion: 2.1 time: 0.172337 Jun 23 22:41:55.447199 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 316/607] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:55 2022] GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 => generated 1555 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:55.464829 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-97dfd3a5-167b-421a-9691-f356b7640248 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:55.465781 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-97dfd3a5-167b-421a-9691-f356b7640248 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:55.467843 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=2,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:41:55.477012 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-97dfd3a5-167b-421a-9691-f356b7640248 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:55.477500 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-97dfd3a5-167b-421a-9691-f356b7640248 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:55.478869 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-97dfd3a5-167b-421a-9691-f356b7640248 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:55.479365 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-97dfd3a5-167b-421a-9691-f356b7640248 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:55.514524 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-75387364-5ff0-4df1-a0b1-09b6bb8d9d92 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:55.519485 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-75387364-5ff0-4df1-a0b1-09b6bb8d9d92 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: b1da69bd-51f5-4223-b7aa-652d2636f36b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:55.527965 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-75387364-5ff0-4df1-a0b1-09b6bb8d9d92 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:55.529355 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-75387364-5ff0-4df1-a0b1-09b6bb8d9d92 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:55.530072 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-75387364-5ff0-4df1-a0b1-09b6bb8d9d92 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:55.530508 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-75387364-5ff0-4df1-a0b1-09b6bb8d9d92 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:55.557684 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.wsgi [None req-75387364-5ff0-4df1-a0b1-09b6bb8d9d92 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] HTTP exception thrown: Instance b1da69bd-51f5-4223-b7aa-652d2636f36b could not be found. Jun 23 22:41:55.559415 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-75387364-5ff0-4df1-a0b1-09b6bb8d9d92 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Request method failure captured: Jun 23 22:41:55.559415 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: request: GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b HTTP/1.1 Jun 23 22:41:55.559415 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept: application/json Jun 23 22:41:55.559415 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept-Encoding: identity Jun 23 22:41:55.559415 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Connection: close Jun 23 22:41:55.559415 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Length: 0 Jun 23 22:41:55.559415 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Type: application/json Jun 23 22:41:55.559415 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Host: 10.222.0.43 Jun 23 22:41:55.559415 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Openstack-System-Scope: None Jun 23 22:41:55.559415 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: User-Agent: python-urllib3/1.26.9 Jun 23 22:41:55.559415 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Auth-Token: gAAAAABitOtjK-HI-EazU9u8w27rOjb4jM7eTXV67Bd6K7P0dzm98kyrdkjM0-jNhq89rpjjonjyRcrsCo5A7kac4Zva6tbEGhVRgOLyRjAF7_VOe1y4KF3FEl3LlFyHRRNXCu6dcVP9ay6Ryc7KhV0KLDkq9yUOyPB3ekv38VWERYsVPIua0RE Jun 23 22:41:55.559415 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Id: None Jun 23 22:41:55.559415 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Name: None Jun 23 22:41:55.559415 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Identity-Status: Confirmed Jun 23 22:41:55.559415 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Is-Admin-Project: True Jun 23 22:41:55.559415 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Id: default Jun 23 22:41:55.559415 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Name: Default Jun 23 22:41:55.559415 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Id: 1eb4b659032e4ec09a16c45b29d609f0 Jun 23 22:41:55.559415 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Name: tempest-TestVolumeBootPattern-1137358917 Jun 23 22:41:55.559415 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Role: reader,member Jun 23 22:41:55.559415 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Roles: reader,member Jun 23 22:41:55.560872 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1eb4b659032e4ec09a16c45b29d609f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1eb4b659032e4ec09a16c45b29d609f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1eb4b659032e4ec09a16c45b29d609f0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1eb4b659032e4ec09a16c45b29d609f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:41:55.560872 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant: tempest-TestVolumeBootPattern-1137358917 Jun 23 22:41:55.560872 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Id: 1eb4b659032e4ec09a16c45b29d609f0 Jun 23 22:41:55.560872 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Name: tempest-TestVolumeBootPattern-1137358917 Jun 23 22:41:55.560872 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User: tempest-TestVolumeBootPattern-1137358917-project Jun 23 22:41:55.560872 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Id: default Jun 23 22:41:55.560872 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Name: Default Jun 23 22:41:55.560872 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Id: f523b529906f4fa989d0e836d6a08944 Jun 23 22:41:55.560872 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Name: tempest-TestVolumeBootPattern-1137358917-project Jun 23 22:41:55.560872 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: method: > Jun 23 22:41:55.560872 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: exception: Instance b1da69bd-51f5-4223-b7aa-652d2636f36b could not be found. Jun 23 22:41:55.560872 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: action_args: {'id': 'b1da69bd-51f5-4223-b7aa-652d2636f36b'} Jun 23 22:41:55.561671 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:41:55.561671 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:41:55.561671 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:41:55.561671 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:41:55.561671 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:41:55.561671 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:41:55.561671 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:41:55.561671 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:41:55.561671 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:41:55.561671 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:41:55.561671 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1da69bd-51f5-4223-b7aa-652d2636f36b could not be found. Jun 23 22:41:55.561671 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:41:55.561671 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:41:55.561671 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:41:55.561671 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:41:55.561671 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:41:55.561671 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:41:55.561671 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:41:55.561671 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:41:55.561671 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:41:55.562899 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:41:55.562899 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:41:55.562899 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:41:55.562899 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:41:55.562899 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:41:55.562899 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:41:55.562899 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:41:55.562899 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1da69bd-51f5-4223-b7aa-652d2636f36b could not be found. Jun 23 22:41:55.562899 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:41:55.562899 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:41:55.562899 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:41:55.562899 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:41:55.562899 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:41:55.562899 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:41:55.562899 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:41:55.562899 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:41:55.562899 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1da69bd-51f5-4223-b7aa-652d2636f36b could not be found. Jun 23 22:41:55.562899 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:41:55.565902 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-75387364-5ff0-4df1-a0b1-09b6bb8d9d92 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Returning 404 to user: Instance b1da69bd-51f5-4223-b7aa-652d2636f36b could not be found. {{(pid=124357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:41:55.565902 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-75387364-5ff0-4df1-a0b1-09b6bb8d9d92 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b" status: 404 len: 111 microversion: 2.1 time: 0.076542 Jun 23 22:41:55.565902 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 317/608] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:55 2022] GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 22:41:55.644820 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-97dfd3a5-167b-421a-9691-f356b7640248 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.184223 Jun 23 22:41:55.644820 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 292/609] 10.222.0.43 () {58 vars in 1274 bytes} [Thu Jun 23 22:41:55 2022] GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4/os-interface => generated 284 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:41:55.723762 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-17e5ca65-d24d-4d32-abb1-55465d385c22 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1261863242", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-932418013", "security_groups": [{"name": "tempest-secgroup-smoke-2066458815"}], "block_device_mapping_v2": [{"uuid": "2e8224e3-36d7-48fe-9f6a-9220a56ff584", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0799b4b1-d9c3-4fcf-beb9-9324c17ca4f1"}]}} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:41:55.924787 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.network.neutron [None req-17e5ca65-d24d-4d32-abb1-55465d385c22 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] validate_networks() for [('0799b4b1-d9c3-4fcf-beb9-9324c17ca4f1', None, None, None, None, None)] {{(pid=124357) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:41:56.149797 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a4af1b25-2804-4a91-8664-b77f39a40040 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Action: 'create', calling method: .version_select at 0x7fb719f8af70>, body: {"keypair": {"name": "tempest-keypair-1318055940", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnuWsoTIgMIXAbgOH7ps/7nABD/HWAJSXr0fDKwrP699Hgvt2bmsxQAxxuI06pRP6D8Mdj4zd58pKcwUgCeFvCZ5HTu4YTIO/LEHadkQVRfnuzoGNnnA/HJhybe6Zeq3g=="}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:41:56.168151 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-a4af1b25-2804-4a91-8664-b77f39a40040 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Getting quotas for project 9ab3a2e6c9634a06b33f1d82a28dc3f1. Resources: {'key_pairs'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:41:56.172741 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-a4af1b25-2804-4a91-8664-b77f39a40040 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Getting quotas for user 1a93ea9f0a3f47d68e53c464c1d52c92 and project 9ab3a2e6c9634a06b33f1d82a28dc3f1. Resources: {'key_pairs'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:41:56.197754 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-a4af1b25-2804-4a91-8664-b77f39a40040 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.112615 Jun 23 22:41:56.198350 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 293/610] 10.222.0.43 () {62 vars in 1199 bytes} [Thu Jun 23 22:41:56 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 114 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 23 22:41:57.243791 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-17e5ca65-d24d-4d32-abb1-55465d385c22 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Flavor limits 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:41:57.245479 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-17e5ca65-d24d-4d32-abb1-55465d385c22 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Image limits 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:41:57.245479 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-17e5ca65-d24d-4d32-abb1-55465d385c22 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Flavor pref 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:41:57.245673 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-17e5ca65-d24d-4d32-abb1-55465d385c22 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Image pref 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:41:57.245966 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-17e5ca65-d24d-4d32-abb1-55465d385c22 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:41:57.256122 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-17e5ca65-d24d-4d32-abb1-55465d385c22 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:57.256883 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-17e5ca65-d24d-4d32-abb1-55465d385c22 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:57.257960 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-17e5ca65-d24d-4d32-abb1-55465d385c22 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:57.258570 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-17e5ca65-d24d-4d32-abb1-55465d385c22 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:57.278727 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-17e5ca65-d24d-4d32-abb1-55465d385c22 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Getting quotas for project 1eb4b659032e4ec09a16c45b29d609f0. Resources: {'instances', 'cores', 'ram'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:41:57.288566 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-17e5ca65-d24d-4d32-abb1-55465d385c22 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Getting quotas for user f523b529906f4fa989d0e836d6a08944 and project 1eb4b659032e4ec09a16c45b29d609f0. Resources: {'instances', 'cores', 'ram'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:41:57.381335 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-17e5ca65-d24d-4d32-abb1-55465d385c22 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Going to run 1 instances... {{(pid=124357) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:41:57.383472 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-17e5ca65-d24d-4d32-abb1-55465d385c22 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 846b1b54-898a-4e88-8367-3ffa42bf0d14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2e8224e3-36d7-48fe-9f6a-9220a56ff584',volume_size=None,volume_type=None)] {{(pid=124357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:41:57.516802 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-476945e7-47b8-4e7a-84c6-832b1d6b5ac9 req-21050d0d-7143-459e-87bd-dfb5d0538e65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4", "tag": "f62d6650-e1ce-4156-9949-4d5a16040e59"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:41:57.528255 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-476945e7-47b8-4e7a-84c6-832b1d6b5ac9 req-21050d0d-7143-459e-87bd-dfb5d0538e65 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:57.528947 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-476945e7-47b8-4e7a-84c6-832b1d6b5ac9 req-21050d0d-7143-459e-87bd-dfb5d0538e65 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:57.542035 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-476945e7-47b8-4e7a-84c6-832b1d6b5ac9 req-21050d0d-7143-459e-87bd-dfb5d0538e65 service nova] Creating event network-changed:f62d6650-e1ce-4156-9949-4d5a16040e59 for instance ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 on hv-cinder-84617 Jun 23 22:41:57.548719 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-476945e7-47b8-4e7a-84c6-832b1d6b5ac9 req-21050d0d-7143-459e-87bd-dfb5d0538e65 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035648 Jun 23 22:41:57.549648 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 294/611] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:41:57.600738 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-17e5ca65-d24d-4d32-abb1-55465d385c22 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.881334 Jun 23 22:41:57.602171 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 318/612] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Jun 23 22:41:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 1883 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 22:41:57.616283 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-47cb655d-e7d4-4c81-9a9a-2fcfcbaef363 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:57.617544 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-47cb655d-e7d4-4c81-9a9a-2fcfcbaef363 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 846b1b54-898a-4e88-8367-3ffa42bf0d14] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:57.731762 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-47cb655d-e7d4-4c81-9a9a-2fcfcbaef363 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:57.742316 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-47cb655d-e7d4-4c81-9a9a-2fcfcbaef363 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14" status: 200 len: 1094 microversion: 2.1 time: 0.129620 Jun 23 22:41:57.742316 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 295/613] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:57 2022] GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14 => generated 1094 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:41:57.970297 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-6acca6a9-413c-478f-81ec-4237da3fd26f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1504858033", "imageRef": "ac7d441e-2ac8-49ad-9dc5-3c55bd4b4f8b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c8ffa52a-0ee3-4aa1-92ba-211a08d60da3"}], "security_groups": [{"name": "tempest-securitygroup--1926015286"}], "key_name": "tempest-keypair-1318055940", "user_data": "}} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:41:57.979193 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:41:58.203034 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.network.neutron [None req-6acca6a9-413c-478f-81ec-4237da3fd26f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] validate_networks() for [('c8ffa52a-0ee3-4aa1-92ba-211a08d60da3', None, None, None, None, None)] {{(pid=124357) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:41:58.756550 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d8d9bc00-a211-4211-b1b3-7fdcdd21002f tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:58.757807 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-d8d9bc00-a211-4211-b1b3-7fdcdd21002f tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 846b1b54-898a-4e88-8367-3ffa42bf0d14] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:58.772765 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d8d9bc00-a211-4211-b1b3-7fdcdd21002f tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:58.773625 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d8d9bc00-a211-4211-b1b3-7fdcdd21002f tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:58.776116 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d8d9bc00-a211-4211-b1b3-7fdcdd21002f tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:58.776726 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d8d9bc00-a211-4211-b1b3-7fdcdd21002f tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:58.997906 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d8d9bc00-a211-4211-b1b3-7fdcdd21002f tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:59.014276 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d8d9bc00-a211-4211-b1b3-7fdcdd21002f tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14" status: 200 len: 1136 microversion: 2.1 time: 0.262472 Jun 23 22:41:59.025376 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 296/614] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:41:58 2022] GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14 => generated 1136 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:41:59.113680 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-6acca6a9-413c-478f-81ec-4237da3fd26f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Flavor limits 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:41:59.114825 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-6acca6a9-413c-478f-81ec-4237da3fd26f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Image limits 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:41:59.115541 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-6acca6a9-413c-478f-81ec-4237da3fd26f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Flavor pref 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:41:59.116103 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-6acca6a9-413c-478f-81ec-4237da3fd26f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Image pref 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:41:59.116695 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-6acca6a9-413c-478f-81ec-4237da3fd26f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:41:59.144118 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6acca6a9-413c-478f-81ec-4237da3fd26f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:59.144751 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6acca6a9-413c-478f-81ec-4237da3fd26f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:59.149107 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6acca6a9-413c-478f-81ec-4237da3fd26f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:41:59.152178 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6acca6a9-413c-478f-81ec-4237da3fd26f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:41:59.177883 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-6acca6a9-413c-478f-81ec-4237da3fd26f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Getting quotas for project 9ab3a2e6c9634a06b33f1d82a28dc3f1. Resources: {'instances', 'cores', 'ram'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:41:59.183149 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-6acca6a9-413c-478f-81ec-4237da3fd26f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Getting quotas for user 1a93ea9f0a3f47d68e53c464c1d52c92 and project 9ab3a2e6c9634a06b33f1d82a28dc3f1. Resources: {'instances', 'cores', 'ram'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:41:59.197705 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-6acca6a9-413c-478f-81ec-4237da3fd26f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Going to run 1 instances... {{(pid=124357) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:41:59.200080 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-6acca6a9-413c-478f-81ec-4237da3fd26f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ac7d441e-2ac8-49ad-9dc5-3c55bd4b4f8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:41:59.272657 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-6acca6a9-413c-478f-81ec-4237da3fd26f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.307693 Jun 23 22:41:59.273790 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 319/615] 10.222.0.43 () {62 vars in 1187 bytes} [Thu Jun 23 22:41:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 1311 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 23 22:41:59.284111 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-69a6d2dc-e438-4731-b793-4e1439316434 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:41:59.284844 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-69a6d2dc-e438-4731-b793-4e1439316434 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:41:59.385954 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-69a6d2dc-e438-4731-b793-4e1439316434 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:59.394444 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-69a6d2dc-e438-4731-b793-4e1439316434 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:59.398356 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-69a6d2dc-e438-4731-b793-4e1439316434 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:41:59.400054 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-69a6d2dc-e438-4731-b793-4e1439316434 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1282 microversion: 2.20 time: 0.120009 Jun 23 22:41:59.400782 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 297/616] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:41:59 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1282 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:42:00.035013 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-a4d83498-fd65-4e46-b5bc-9a7f5639fe16 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:00.036111 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-a4d83498-fd65-4e46-b5bc-9a7f5639fe16 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 846b1b54-898a-4e88-8367-3ffa42bf0d14] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:00.045002 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a4d83498-fd65-4e46-b5bc-9a7f5639fe16 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:00.045670 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a4d83498-fd65-4e46-b5bc-9a7f5639fe16 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:00.046870 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a4d83498-fd65-4e46-b5bc-9a7f5639fe16 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:00.048575 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a4d83498-fd65-4e46-b5bc-9a7f5639fe16 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:00.147083 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-a4d83498-fd65-4e46-b5bc-9a7f5639fe16 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:00.161708 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-a4d83498-fd65-4e46-b5bc-9a7f5639fe16 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14" status: 200 len: 1210 microversion: 2.1 time: 0.132419 Jun 23 22:42:00.162584 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 320/617] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:00 2022] GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14 => generated 1210 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:00.420041 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-4a39f90f-6cdb-488e-a407-d3e58a19a426 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:00.420802 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-4a39f90f-6cdb-488e-a407-d3e58a19a426 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:00.427436 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4a39f90f-6cdb-488e-a407-d3e58a19a426 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:00.428005 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4a39f90f-6cdb-488e-a407-d3e58a19a426 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:00.428830 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4a39f90f-6cdb-488e-a407-d3e58a19a426 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:00.429424 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4a39f90f-6cdb-488e-a407-d3e58a19a426 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:00.525488 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4a39f90f-6cdb-488e-a407-d3e58a19a426 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:00.535845 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4a39f90f-6cdb-488e-a407-d3e58a19a426 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:00.537221 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4a39f90f-6cdb-488e-a407-d3e58a19a426 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:00.538398 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-4a39f90f-6cdb-488e-a407-d3e58a19a426 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1334 microversion: 2.20 time: 0.123800 Jun 23 22:42:00.538886 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 298/618] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:42:00 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1334 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:42:01.180472 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-79b92280-a890-426a-a844-2aec87e3b67c tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:01.181090 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-79b92280-a890-426a-a844-2aec87e3b67c tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 846b1b54-898a-4e88-8367-3ffa42bf0d14] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:01.191185 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-79b92280-a890-426a-a844-2aec87e3b67c tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:01.191888 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-79b92280-a890-426a-a844-2aec87e3b67c tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:01.192666 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-79b92280-a890-426a-a844-2aec87e3b67c tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:01.193251 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-79b92280-a890-426a-a844-2aec87e3b67c tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:01.444614 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-79b92280-a890-426a-a844-2aec87e3b67c tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:01.448587 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:42:01.454297 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-79b92280-a890-426a-a844-2aec87e3b67c tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14" status: 200 len: 1266 microversion: 2.1 time: 0.278094 Jun 23 22:42:01.454861 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 321/619] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:01 2022] GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14 => generated 1266 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:01.563786 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-3fa3f815-a70d-4e47-8238-85b649ced7a7 req-27cdfbfd-15a1-4dc8-be8c-514cc1f38969 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "846b1b54-898a-4e88-8367-3ffa42bf0d14", "tag": "876447a5-4914-447d-9445-4888cf15aa9a"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:42:01.574663 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-fc51f3df-e8ea-449e-8610-c89269d8649d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:01.582829 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-3fa3f815-a70d-4e47-8238-85b649ced7a7 req-27cdfbfd-15a1-4dc8-be8c-514cc1f38969 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:01.583300 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-3fa3f815-a70d-4e47-8238-85b649ced7a7 req-27cdfbfd-15a1-4dc8-be8c-514cc1f38969 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:01.584625 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-fc51f3df-e8ea-449e-8610-c89269d8649d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:01.601965 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fc51f3df-e8ea-449e-8610-c89269d8649d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:01.602415 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fc51f3df-e8ea-449e-8610-c89269d8649d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:01.603222 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fc51f3df-e8ea-449e-8610-c89269d8649d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:01.604478 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fc51f3df-e8ea-449e-8610-c89269d8649d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:01.621573 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-3fa3f815-a70d-4e47-8238-85b649ced7a7 req-27cdfbfd-15a1-4dc8-be8c-514cc1f38969 service nova] Creating event network-changed:876447a5-4914-447d-9445-4888cf15aa9a for instance 846b1b54-898a-4e88-8367-3ffa42bf0d14 on hv-cinder-84617 Jun 23 22:42:01.626357 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-3fa3f815-a70d-4e47-8238-85b649ced7a7 req-27cdfbfd-15a1-4dc8-be8c-514cc1f38969 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072385 Jun 23 22:42:01.627335 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 299/620] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:42:01.756049 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-fc51f3df-e8ea-449e-8610-c89269d8649d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:01.766774 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-fc51f3df-e8ea-449e-8610-c89269d8649d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:01.768563 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-fc51f3df-e8ea-449e-8610-c89269d8649d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:01.769807 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-fc51f3df-e8ea-449e-8610-c89269d8649d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1340 microversion: 2.20 time: 0.199923 Jun 23 22:42:01.770460 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 322/621] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:42:01 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1340 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:42:02.472143 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f6ad2abf-5254-4f92-aaad-f4f1f6e59f79 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:02.472942 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-f6ad2abf-5254-4f92-aaad-f4f1f6e59f79 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 846b1b54-898a-4e88-8367-3ffa42bf0d14] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:02.479871 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f6ad2abf-5254-4f92-aaad-f4f1f6e59f79 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:02.480475 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f6ad2abf-5254-4f92-aaad-f4f1f6e59f79 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:02.481248 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f6ad2abf-5254-4f92-aaad-f4f1f6e59f79 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:02.481678 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f6ad2abf-5254-4f92-aaad-f4f1f6e59f79 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:02.788517 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-6c67c26a-ea0e-462d-b07d-ab0660964aba tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:02.789285 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-6c67c26a-ea0e-462d-b07d-ab0660964aba tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:02.796734 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6c67c26a-ea0e-462d-b07d-ab0660964aba tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:02.797178 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6c67c26a-ea0e-462d-b07d-ab0660964aba tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:02.797947 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6c67c26a-ea0e-462d-b07d-ab0660964aba tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:02.798377 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6c67c26a-ea0e-462d-b07d-ab0660964aba tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:02.836906 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f6ad2abf-5254-4f92-aaad-f4f1f6e59f79 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:02.844930 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f6ad2abf-5254-4f92-aaad-f4f1f6e59f79 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14" status: 200 len: 1266 microversion: 2.1 time: 0.376997 Jun 23 22:42:02.852642 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 300/622] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:02 2022] GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14 => generated 1266 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:02.967739 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-6c67c26a-ea0e-462d-b07d-ab0660964aba tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:02.975741 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-6c67c26a-ea0e-462d-b07d-ab0660964aba tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:02.977270 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-6c67c26a-ea0e-462d-b07d-ab0660964aba tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:02.978513 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-6c67c26a-ea0e-462d-b07d-ab0660964aba tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1408 microversion: 2.20 time: 0.193865 Jun 23 22:42:02.978973 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 323/623] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:42:02 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1408 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:42:03.861757 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-0f44ba96-ccff-48ef-adda-8268d4cdc6f3 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:03.862375 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-0f44ba96-ccff-48ef-adda-8268d4cdc6f3 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 846b1b54-898a-4e88-8367-3ffa42bf0d14] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:03.868749 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0f44ba96-ccff-48ef-adda-8268d4cdc6f3 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:03.869237 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0f44ba96-ccff-48ef-adda-8268d4cdc6f3 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:03.870088 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0f44ba96-ccff-48ef-adda-8268d4cdc6f3 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:03.870525 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0f44ba96-ccff-48ef-adda-8268d4cdc6f3 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:03.997096 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-3cac3984-c334-4788-ae5b-b471ce3600d8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:03.997711 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-3cac3984-c334-4788-ae5b-b471ce3600d8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:04.013071 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3cac3984-c334-4788-ae5b-b471ce3600d8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:04.013521 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3cac3984-c334-4788-ae5b-b471ce3600d8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:04.014303 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3cac3984-c334-4788-ae5b-b471ce3600d8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:04.014739 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3cac3984-c334-4788-ae5b-b471ce3600d8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:04.235468 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-0f44ba96-ccff-48ef-adda-8268d4cdc6f3 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:04.243450 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-0f44ba96-ccff-48ef-adda-8268d4cdc6f3 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14" status: 200 len: 1266 microversion: 2.1 time: 0.385538 Jun 23 22:42:04.244563 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 301/624] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:03 2022] GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14 => generated 1266 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:04.249754 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a49e3bcd-8d42-4ea0-889a-a341284698c4 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:04.250430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-a49e3bcd-8d42-4ea0-889a-a341284698c4 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: 3125a0e6-6f0f-408b-8d73-08610945e52e] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:04.257282 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a49e3bcd-8d42-4ea0-889a-a341284698c4 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:04.257727 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a49e3bcd-8d42-4ea0-889a-a341284698c4 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:04.258492 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a49e3bcd-8d42-4ea0-889a-a341284698c4 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:04.258916 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a49e3bcd-8d42-4ea0-889a-a341284698c4 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:04.284758 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-a49e3bcd-8d42-4ea0-889a-a341284698c4 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e/ips" status: 200 len: 146 microversion: 2.1 time: 0.038540 Jun 23 22:42:04.291488 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 302/625] 10.222.0.43 () {58 vars in 1247 bytes} [Thu Jun 23 22:42:04 2022] GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:42:04.325835 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-3cac3984-c334-4788-ae5b-b471ce3600d8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:04.334870 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-3cac3984-c334-4788-ae5b-b471ce3600d8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:04.336635 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-3cac3984-c334-4788-ae5b-b471ce3600d8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:04.338524 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-3cac3984-c334-4788-ae5b-b471ce3600d8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1408 microversion: 2.20 time: 0.345493 Jun 23 22:42:04.339339 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 324/626] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:42:03 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1408 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:42:04.476046 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-25dac5e4-53b2-4487-9c24-9719de4c33ee req-33fb32d5-048f-43ab-a1f2-f59a710b724f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b2f6937-650f-42b2-83cb-f2f54c40a6b3", "tag": "25e676fe-9948-4de4-91ae-b15fb391a86c"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:42:04.492874 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-25dac5e4-53b2-4487-9c24-9719de4c33ee req-33fb32d5-048f-43ab-a1f2-f59a710b724f service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:04.493793 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-25dac5e4-53b2-4487-9c24-9719de4c33ee req-33fb32d5-048f-43ab-a1f2-f59a710b724f service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:04.518911 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-25dac5e4-53b2-4487-9c24-9719de4c33ee req-33fb32d5-048f-43ab-a1f2-f59a710b724f service nova] Creating event network-changed:25e676fe-9948-4de4-91ae-b15fb391a86c for instance 7b2f6937-650f-42b2-83cb-f2f54c40a6b3 on hv-cinder-84617 Jun 23 22:42:04.527922 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-25dac5e4-53b2-4487-9c24-9719de4c33ee req-33fb32d5-048f-43ab-a1f2-f59a710b724f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059302 Jun 23 22:42:04.529091 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 303/627] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:42:05.261322 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-31aa044b-a07c-4b16-a4fe-41f5e1d48e95 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:05.261932 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-31aa044b-a07c-4b16-a4fe-41f5e1d48e95 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 846b1b54-898a-4e88-8367-3ffa42bf0d14] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:05.268450 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-31aa044b-a07c-4b16-a4fe-41f5e1d48e95 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:05.268897 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-31aa044b-a07c-4b16-a4fe-41f5e1d48e95 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:05.269657 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-31aa044b-a07c-4b16-a4fe-41f5e1d48e95 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:05.270091 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-31aa044b-a07c-4b16-a4fe-41f5e1d48e95 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:05.358250 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-61ff69be-3b4c-4e3e-bcc0-2c5e249f8bce tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:05.358968 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-61ff69be-3b4c-4e3e-bcc0-2c5e249f8bce tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:05.365203 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-61ff69be-3b4c-4e3e-bcc0-2c5e249f8bce tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:05.365649 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-61ff69be-3b4c-4e3e-bcc0-2c5e249f8bce tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:05.366449 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-61ff69be-3b4c-4e3e-bcc0-2c5e249f8bce tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:05.366892 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-61ff69be-3b4c-4e3e-bcc0-2c5e249f8bce tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:05.404040 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-31aa044b-a07c-4b16-a4fe-41f5e1d48e95 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:05.411573 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-31aa044b-a07c-4b16-a4fe-41f5e1d48e95 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14" status: 200 len: 1266 microversion: 2.1 time: 0.154736 Jun 23 22:42:05.412143 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 325/628] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:05 2022] GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:05.500615 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-61ff69be-3b4c-4e3e-bcc0-2c5e249f8bce tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:05.508754 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-61ff69be-3b4c-4e3e-bcc0-2c5e249f8bce tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:05.510462 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-61ff69be-3b4c-4e3e-bcc0-2c5e249f8bce tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:05.511702 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-61ff69be-3b4c-4e3e-bcc0-2c5e249f8bce tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1408 microversion: 2.20 time: 0.158754 Jun 23 22:42:05.512203 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 304/629] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:42:05 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:42:05.724122 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-a116af8f-cdb0-4d6e-9959-755ffec533c6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24103e16-0115-4e9c-92d5-d60afe59e8ab"}} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:42:05.725264 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-a116af8f-cdb0-4d6e-9959-755ffec533c6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: 3125a0e6-6f0f-408b-8d73-08610945e52e] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:05.731887 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a116af8f-cdb0-4d6e-9959-755ffec533c6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:05.732328 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a116af8f-cdb0-4d6e-9959-755ffec533c6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:05.733080 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a116af8f-cdb0-4d6e-9959-755ffec533c6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:05.733507 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a116af8f-cdb0-4d6e-9959-755ffec533c6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:06.430433 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-23582113-b747-40ab-bd1f-893c12fe0db2 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:06.431809 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-23582113-b747-40ab-bd1f-893c12fe0db2 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 846b1b54-898a-4e88-8367-3ffa42bf0d14] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:06.440685 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-23582113-b747-40ab-bd1f-893c12fe0db2 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:06.441081 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-23582113-b747-40ab-bd1f-893c12fe0db2 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:06.441513 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-a116af8f-cdb0-4d6e-9959-755ffec533c6 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "POST /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.721125 Jun 23 22:42:06.441975 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-23582113-b747-40ab-bd1f-893c12fe0db2 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:06.442334 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-23582113-b747-40ab-bd1f-893c12fe0db2 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:06.442469 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 326/630] 10.222.0.43 () {60 vars in 1322 bytes} [Thu Jun 23 22:42:05 2022] POST /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e/os-volume_attachments => generated 194 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:42:06.531296 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-e672b2e3-505b-4c06-8433-51087611cb49 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:06.531993 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-e672b2e3-505b-4c06-8433-51087611cb49 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:06.538630 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-e672b2e3-505b-4c06-8433-51087611cb49 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:06.539119 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-e672b2e3-505b-4c06-8433-51087611cb49 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:06.540353 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-e672b2e3-505b-4c06-8433-51087611cb49 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:06.540850 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-e672b2e3-505b-4c06-8433-51087611cb49 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:06.995539 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-23582113-b747-40ab-bd1f-893c12fe0db2 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:07.003161 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-23582113-b747-40ab-bd1f-893c12fe0db2 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14" status: 200 len: 1266 microversion: 2.1 time: 0.577857 Jun 23 22:42:07.004042 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 305/631] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:06 2022] GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14 => generated 1266 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:07.020260 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-e672b2e3-505b-4c06-8433-51087611cb49 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:07.029490 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-e672b2e3-505b-4c06-8433-51087611cb49 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:07.031037 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-e672b2e3-505b-4c06-8433-51087611cb49 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:07.032141 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-e672b2e3-505b-4c06-8433-51087611cb49 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1408 microversion: 2.20 time: 0.506182 Jun 23 22:42:07.032695 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 327/632] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:42:06 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1408 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:42:08.021212 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-75c339e1-47c9-4608-8e9a-cb77a0a6c6ba tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:08.021705 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-75c339e1-47c9-4608-8e9a-cb77a0a6c6ba tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 846b1b54-898a-4e88-8367-3ffa42bf0d14] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:08.028860 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-75c339e1-47c9-4608-8e9a-cb77a0a6c6ba tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:08.029299 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-75c339e1-47c9-4608-8e9a-cb77a0a6c6ba tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:08.030048 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-75c339e1-47c9-4608-8e9a-cb77a0a6c6ba tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:08.030471 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-75c339e1-47c9-4608-8e9a-cb77a0a6c6ba tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:08.050636 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-1bfd8d3e-8bcb-412f-9158-22968430b565 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:08.051410 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-1bfd8d3e-8bcb-412f-9158-22968430b565 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:08.058060 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1bfd8d3e-8bcb-412f-9158-22968430b565 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:08.058577 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1bfd8d3e-8bcb-412f-9158-22968430b565 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:08.059440 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1bfd8d3e-8bcb-412f-9158-22968430b565 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:08.059942 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1bfd8d3e-8bcb-412f-9158-22968430b565 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:08.235606 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-75c339e1-47c9-4608-8e9a-cb77a0a6c6ba tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:08.243345 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-1bfd8d3e-8bcb-412f-9158-22968430b565 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:08.243579 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-75c339e1-47c9-4608-8e9a-cb77a0a6c6ba tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14" status: 200 len: 1266 microversion: 2.1 time: 0.226317 Jun 23 22:42:08.245291 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 306/633] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:08 2022] GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14 => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:08.261853 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-1bfd8d3e-8bcb-412f-9158-22968430b565 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:08.263445 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-1bfd8d3e-8bcb-412f-9158-22968430b565 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:08.264584 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-1bfd8d3e-8bcb-412f-9158-22968430b565 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1408 microversion: 2.20 time: 0.217829 Jun 23 22:42:08.265132 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 328/634] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:42:08 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1408 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:42:09.267329 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a8a8facb-8f1e-4037-afd0-dc1c9a979538 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:09.268091 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-a8a8facb-8f1e-4037-afd0-dc1c9a979538 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 846b1b54-898a-4e88-8367-3ffa42bf0d14] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:09.280056 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a8a8facb-8f1e-4037-afd0-dc1c9a979538 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:09.281567 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a8a8facb-8f1e-4037-afd0-dc1c9a979538 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:09.282534 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a8a8facb-8f1e-4037-afd0-dc1c9a979538 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:09.282990 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a8a8facb-8f1e-4037-afd0-dc1c9a979538 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:09.285496 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-3050cd4a-fae0-432d-b035-c7e7eb837a93 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:09.286347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-3050cd4a-fae0-432d-b035-c7e7eb837a93 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:09.288913 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell0:SELECT=4 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:42:09.289902 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell0:SELECT=12 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:42:09.301752 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3050cd4a-fae0-432d-b035-c7e7eb837a93 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:09.302112 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3050cd4a-fae0-432d-b035-c7e7eb837a93 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:09.302894 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3050cd4a-fae0-432d-b035-c7e7eb837a93 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:09.303364 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3050cd4a-fae0-432d-b035-c7e7eb837a93 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:09.396334 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=8 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:42:09.480429 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-a8a8facb-8f1e-4037-afd0-dc1c9a979538 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:09.482623 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=100 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:42:09.489093 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-a8a8facb-8f1e-4037-afd0-dc1c9a979538 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14" status: 200 len: 1266 microversion: 2.1 time: 0.231660 Jun 23 22:42:09.489672 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 307/635] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:09 2022] GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14 => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:09.503851 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-3050cd4a-fae0-432d-b035-c7e7eb837a93 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:09.512526 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-3050cd4a-fae0-432d-b035-c7e7eb837a93 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:09.514041 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-3050cd4a-fae0-432d-b035-c7e7eb837a93 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:09.515198 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-3050cd4a-fae0-432d-b035-c7e7eb837a93 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1408 microversion: 2.20 time: 0.235296 Jun 23 22:42:09.515757 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 329/636] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:42:09 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1408 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:42:09.743078 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-626115f3-6090-4734-8739-852f00433ba2 req-3a2a2a7e-a4f2-4786-b260-dde779ca9823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b2f6937-650f-42b2-83cb-f2f54c40a6b3", "name": "network-vif-plugged", "status": "completed", "tag": "25e676fe-9948-4de4-91ae-b15fb391a86c"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:42:09.752360 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-626115f3-6090-4734-8739-852f00433ba2 req-3a2a2a7e-a4f2-4786-b260-dde779ca9823 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:09.752741 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-626115f3-6090-4734-8739-852f00433ba2 req-3a2a2a7e-a4f2-4786-b260-dde779ca9823 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:09.765101 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-626115f3-6090-4734-8739-852f00433ba2 req-3a2a2a7e-a4f2-4786-b260-dde779ca9823 service nova] Creating event network-vif-plugged:25e676fe-9948-4de4-91ae-b15fb391a86c for instance 7b2f6937-650f-42b2-83cb-f2f54c40a6b3 on hv-cinder-84617 Jun 23 22:42:09.769847 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-626115f3-6090-4734-8739-852f00433ba2 req-3a2a2a7e-a4f2-4786-b260-dde779ca9823 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030479 Jun 23 22:42:09.770432 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 308/637] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:42:10.507088 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-5e23581e-55e1-4033-b021-d721ddd9e16d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:10.507707 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-5e23581e-55e1-4033-b021-d721ddd9e16d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 846b1b54-898a-4e88-8367-3ffa42bf0d14] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:10.514727 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5e23581e-55e1-4033-b021-d721ddd9e16d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:10.515206 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5e23581e-55e1-4033-b021-d721ddd9e16d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:10.516004 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5e23581e-55e1-4033-b021-d721ddd9e16d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:10.516437 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5e23581e-55e1-4033-b021-d721ddd9e16d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:10.534246 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-1f6231cb-6b9c-4b81-866b-23f7963f7712 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:10.534965 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-1f6231cb-6b9c-4b81-866b-23f7963f7712 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:10.541575 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1f6231cb-6b9c-4b81-866b-23f7963f7712 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:10.542639 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1f6231cb-6b9c-4b81-866b-23f7963f7712 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:10.543758 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1f6231cb-6b9c-4b81-866b-23f7963f7712 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:10.544181 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1f6231cb-6b9c-4b81-866b-23f7963f7712 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:10.718214 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-5e23581e-55e1-4033-b021-d721ddd9e16d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:10.725121 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-1f6231cb-6b9c-4b81-866b-23f7963f7712 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:10.728214 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-5e23581e-55e1-4033-b021-d721ddd9e16d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14" status: 200 len: 1266 microversion: 2.1 time: 0.224955 Jun 23 22:42:10.728792 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 330/638] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:10 2022] GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14 => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:10.738836 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-1f6231cb-6b9c-4b81-866b-23f7963f7712 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:10.740374 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-1f6231cb-6b9c-4b81-866b-23f7963f7712 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:10.742836 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-1f6231cb-6b9c-4b81-866b-23f7963f7712 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1408 microversion: 2.20 time: 0.212020 Jun 23 22:42:10.743441 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 309/639] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:42:10 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1408 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:42:11.744801 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-cc6c46a8-1a1a-4e5b-9bb6-86a2074a8048 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:11.745790 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-cc6c46a8-1a1a-4e5b-9bb6-86a2074a8048 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 846b1b54-898a-4e88-8367-3ffa42bf0d14] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:11.752515 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-cc6c46a8-1a1a-4e5b-9bb6-86a2074a8048 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:11.753167 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-cc6c46a8-1a1a-4e5b-9bb6-86a2074a8048 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:11.753990 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-cc6c46a8-1a1a-4e5b-9bb6-86a2074a8048 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:11.754489 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-cc6c46a8-1a1a-4e5b-9bb6-86a2074a8048 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:11.765154 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-3b7b6e9a-f797-4587-998c-a514d22b5512 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:11.765906 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-3b7b6e9a-f797-4587-998c-a514d22b5512 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:11.772602 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3b7b6e9a-f797-4587-998c-a514d22b5512 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:11.773014 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3b7b6e9a-f797-4587-998c-a514d22b5512 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:11.773813 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3b7b6e9a-f797-4587-998c-a514d22b5512 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:11.774248 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3b7b6e9a-f797-4587-998c-a514d22b5512 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:11.973639 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-cc6c46a8-1a1a-4e5b-9bb6-86a2074a8048 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:11.976878 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-3b7b6e9a-f797-4587-998c-a514d22b5512 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:11.982388 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-cc6c46a8-1a1a-4e5b-9bb6-86a2074a8048 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14" status: 200 len: 1266 microversion: 2.1 time: 0.241302 Jun 23 22:42:11.982997 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 331/640] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:11 2022] GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14 => generated 1266 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:11.986025 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-3b7b6e9a-f797-4587-998c-a514d22b5512 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:11.987644 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-3b7b6e9a-f797-4587-998c-a514d22b5512 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:11.988845 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-3b7b6e9a-f797-4587-998c-a514d22b5512 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1408 microversion: 2.20 time: 0.227687 Jun 23 22:42:11.989471 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 310/641] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:42:11 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1408 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:42:12.999792 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-c2ad8819-051b-4ea9-af75-9be546024739 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:13.000406 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-c2ad8819-051b-4ea9-af75-9be546024739 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 846b1b54-898a-4e88-8367-3ffa42bf0d14] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:13.007151 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c2ad8819-051b-4ea9-af75-9be546024739 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:13.007552 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c5d5eb05-c6ef-42e7-a4df-221268da874b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:13.007965 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c2ad8819-051b-4ea9-af75-9be546024739 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:13.008171 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c5d5eb05-c6ef-42e7-a4df-221268da874b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:13.008413 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c2ad8819-051b-4ea9-af75-9be546024739 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:13.008850 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c2ad8819-051b-4ea9-af75-9be546024739 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:13.015361 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c5d5eb05-c6ef-42e7-a4df-221268da874b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:13.015684 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c5d5eb05-c6ef-42e7-a4df-221268da874b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:13.016446 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c5d5eb05-c6ef-42e7-a4df-221268da874b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:13.016877 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c5d5eb05-c6ef-42e7-a4df-221268da874b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:13.205106 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-c2ad8819-051b-4ea9-af75-9be546024739 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:13.214729 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-c2ad8819-051b-4ea9-af75-9be546024739 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14" status: 200 len: 1266 microversion: 2.1 time: 0.218446 Jun 23 22:42:13.215455 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 332/642] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:12 2022] GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:13.219957 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c5d5eb05-c6ef-42e7-a4df-221268da874b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:13.228300 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c5d5eb05-c6ef-42e7-a4df-221268da874b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:13.229841 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c5d5eb05-c6ef-42e7-a4df-221268da874b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:13.231008 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c5d5eb05-c6ef-42e7-a4df-221268da874b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1599 microversion: 2.20 time: 0.227324 Jun 23 22:42:13.231559 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 311/643] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:42:13 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1599 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:42:13.249933 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-2d04ab04-8a24-4cd8-afef-a42514cc093f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:13.250415 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-2d04ab04-8a24-4cd8-afef-a42514cc093f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:13.256616 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2d04ab04-8a24-4cd8-afef-a42514cc093f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:13.257058 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2d04ab04-8a24-4cd8-afef-a42514cc093f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:13.257835 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2d04ab04-8a24-4cd8-afef-a42514cc093f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:13.258438 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2d04ab04-8a24-4cd8-afef-a42514cc093f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:13.341806 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-2d04ab04-8a24-4cd8-afef-a42514cc093f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.096942 Jun 23 22:42:13.342427 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 333/644] 10.222.0.43 () {60 vars in 1315 bytes} [Thu Jun 23 22:42:13 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 22:42:13.775044 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-02a94af4-aaf9-40af-9936-440f4e33cc10 req-1e5b0973-6d9a-41d4-9b97-ea5df4d667df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "846b1b54-898a-4e88-8367-3ffa42bf0d14", "name": "network-vif-plugged", "status": "completed", "tag": "876447a5-4914-447d-9445-4888cf15aa9a"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:42:13.784055 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-02a94af4-aaf9-40af-9936-440f4e33cc10 req-1e5b0973-6d9a-41d4-9b97-ea5df4d667df service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:13.784585 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-02a94af4-aaf9-40af-9936-440f4e33cc10 req-1e5b0973-6d9a-41d4-9b97-ea5df4d667df service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:13.798660 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-02a94af4-aaf9-40af-9936-440f4e33cc10 req-1e5b0973-6d9a-41d4-9b97-ea5df4d667df service nova] Creating event network-vif-plugged:876447a5-4914-447d-9445-4888cf15aa9a for instance 846b1b54-898a-4e88-8367-3ffa42bf0d14 on hv-cinder-84617 Jun 23 22:42:13.804291 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-02a94af4-aaf9-40af-9936-440f4e33cc10 req-1e5b0973-6d9a-41d4-9b97-ea5df4d667df service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032938 Jun 23 22:42:13.805053 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 312/645] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:42:13.967578 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-b1b461e5-bd1d-4f12-bf74-f9512d5d1cbb tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:13.968574 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-b1b461e5-bd1d-4f12-bf74-f9512d5d1cbb tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: 3125a0e6-6f0f-408b-8d73-08610945e52e] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:13.975593 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-b1b461e5-bd1d-4f12-bf74-f9512d5d1cbb tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:13.976028 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-b1b461e5-bd1d-4f12-bf74-f9512d5d1cbb tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:13.976783 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-b1b461e5-bd1d-4f12-bf74-f9512d5d1cbb tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:13.977213 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-b1b461e5-bd1d-4f12-bf74-f9512d5d1cbb tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:14.010894 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-b1b461e5-bd1d-4f12-bf74-f9512d5d1cbb tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047975 Jun 23 22:42:14.011899 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 334/646] 10.222.0.43 () {58 vars in 1301 bytes} [Thu Jun 23 22:42:13 2022] GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:42:14.022592 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-eb091d0f-a6a4-420c-a4b3-eff8a767ea16 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:14.023677 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-eb091d0f-a6a4-420c-a4b3-eff8a767ea16 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: 3125a0e6-6f0f-408b-8d73-08610945e52e] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:14.030488 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-eb091d0f-a6a4-420c-a4b3-eff8a767ea16 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:14.030972 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-eb091d0f-a6a4-420c-a4b3-eff8a767ea16 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:14.031757 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-eb091d0f-a6a4-420c-a4b3-eff8a767ea16 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:14.032194 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-eb091d0f-a6a4-420c-a4b3-eff8a767ea16 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:14.067146 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-eb091d0f-a6a4-420c-a4b3-eff8a767ea16 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e/os-volume_attachments/24103e16-0115-4e9c-92d5-d60afe59e8ab" status: 200 len: 194 microversion: 2.1 time: 0.049434 Jun 23 22:42:14.067919 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 313/647] 10.222.0.43 () {58 vars in 1412 bytes} [Thu Jun 23 22:42:14 2022] GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e/os-volume_attachments/24103e16-0115-4e9c-92d5-d60afe59e8ab => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:42:14.232061 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-2ad07f29-19d7-4ad2-b90f-9233a7179cec tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:14.232718 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-2ad07f29-19d7-4ad2-b90f-9233a7179cec tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 846b1b54-898a-4e88-8367-3ffa42bf0d14] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:14.239359 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2ad07f29-19d7-4ad2-b90f-9233a7179cec tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:14.239804 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2ad07f29-19d7-4ad2-b90f-9233a7179cec tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:14.240556 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2ad07f29-19d7-4ad2-b90f-9233a7179cec tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:14.240982 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2ad07f29-19d7-4ad2-b90f-9233a7179cec tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:14.458208 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-6f6be720-b6f8-4adb-94c5-ca398f961459 req-099613ca-ced3-4e58-83bb-f1749627be1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b2f6937-650f-42b2-83cb-f2f54c40a6b3", "tag": "25e676fe-9948-4de4-91ae-b15fb391a86c"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:42:14.467621 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-6f6be720-b6f8-4adb-94c5-ca398f961459 req-099613ca-ced3-4e58-83bb-f1749627be1c service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:14.468215 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-6f6be720-b6f8-4adb-94c5-ca398f961459 req-099613ca-ced3-4e58-83bb-f1749627be1c service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:14.476044 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-2ad07f29-19d7-4ad2-b90f-9233a7179cec tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:14.480953 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-6f6be720-b6f8-4adb-94c5-ca398f961459 req-099613ca-ced3-4e58-83bb-f1749627be1c service nova] Creating event network-changed:25e676fe-9948-4de4-91ae-b15fb391a86c for instance 7b2f6937-650f-42b2-83cb-f2f54c40a6b3 on hv-cinder-84617 Jun 23 22:42:14.485625 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-2ad07f29-19d7-4ad2-b90f-9233a7179cec tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14" status: 200 len: 1266 microversion: 2.1 time: 0.258517 Jun 23 22:42:14.486126 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-6f6be720-b6f8-4adb-94c5-ca398f961459 req-099613ca-ced3-4e58-83bb-f1749627be1c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031471 Jun 23 22:42:14.486803 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 314/648] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:42:14.495247 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 335/649] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:14 2022] GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14 => generated 1266 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:15.418993 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e6dbbbe0-1b3c-4218-9c0c-6ad06474dd3b tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "862a0e35-6eac-4b32-90bf-9c9d76ec7f00"}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:42:15.420283 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e6dbbbe0-1b3c-4218-9c0c-6ad06474dd3b tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: 3125a0e6-6f0f-408b-8d73-08610945e52e] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:15.427085 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e6dbbbe0-1b3c-4218-9c0c-6ad06474dd3b tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:15.427613 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e6dbbbe0-1b3c-4218-9c0c-6ad06474dd3b tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:15.428648 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e6dbbbe0-1b3c-4218-9c0c-6ad06474dd3b tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:15.429143 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e6dbbbe0-1b3c-4218-9c0c-6ad06474dd3b tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:15.502955 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-a19ad765-f441-4f6b-ab93-7bcc64324b13 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:15.503651 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-a19ad765-f441-4f6b-ab93-7bcc64324b13 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 846b1b54-898a-4e88-8367-3ffa42bf0d14] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:15.514387 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a19ad765-f441-4f6b-ab93-7bcc64324b13 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:15.514839 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a19ad765-f441-4f6b-ab93-7bcc64324b13 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:15.519100 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a19ad765-f441-4f6b-ab93-7bcc64324b13 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:15.519629 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a19ad765-f441-4f6b-ab93-7bcc64324b13 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:15.763090 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e6dbbbe0-1b3c-4218-9c0c-6ad06474dd3b tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "POST /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.349536 Jun 23 22:42:15.763820 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 315/650] 10.222.0.43 () {60 vars in 1322 bytes} [Thu Jun 23 22:42:15 2022] POST /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e/os-volume_attachments => generated 194 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:42:15.980148 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-a19ad765-f441-4f6b-ab93-7bcc64324b13 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:15.987570 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-a19ad765-f441-4f6b-ab93-7bcc64324b13 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14" status: 200 len: 1266 microversion: 2.1 time: 0.488577 Jun 23 22:42:15.988146 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 336/651] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:15 2022] GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14 => generated 1266 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:42:17.006155 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-eb12acb3-dbd1-4e46-9a2d-46009437d65d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:17.006836 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-eb12acb3-dbd1-4e46-9a2d-46009437d65d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 846b1b54-898a-4e88-8367-3ffa42bf0d14] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:17.014310 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-eb12acb3-dbd1-4e46-9a2d-46009437d65d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:17.014780 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-eb12acb3-dbd1-4e46-9a2d-46009437d65d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:17.015667 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-eb12acb3-dbd1-4e46-9a2d-46009437d65d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:17.016128 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-eb12acb3-dbd1-4e46-9a2d-46009437d65d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:17.153536 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-eb12acb3-dbd1-4e46-9a2d-46009437d65d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:17.161207 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-eb12acb3-dbd1-4e46-9a2d-46009437d65d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14" status: 200 len: 1453 microversion: 2.1 time: 0.160359 Jun 23 22:42:17.161770 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 316/652] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:16 2022] GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14 => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:17.177086 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-243d6df4-6f8e-4fdb-a553-ff0140b71fcd tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:17.177690 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-243d6df4-6f8e-4fdb-a553-ff0140b71fcd tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 846b1b54-898a-4e88-8367-3ffa42bf0d14] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:17.184630 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-243d6df4-6f8e-4fdb-a553-ff0140b71fcd tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:17.185067 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-243d6df4-6f8e-4fdb-a553-ff0140b71fcd tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:17.185806 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-243d6df4-6f8e-4fdb-a553-ff0140b71fcd tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:17.186230 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-243d6df4-6f8e-4fdb-a553-ff0140b71fcd tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:17.204663 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:42:17.318181 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-243d6df4-6f8e-4fdb-a553-ff0140b71fcd tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:17.325946 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-243d6df4-6f8e-4fdb-a553-ff0140b71fcd tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14" status: 200 len: 1453 microversion: 2.1 time: 0.152713 Jun 23 22:42:17.326514 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 337/653] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:17 2022] GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:18.895623 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-ad61e466-3646-4fe9-aa48-63391dbcb779 req-b991e2ff-22e4-4a7f-8ffb-ace0256a5ce6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "846b1b54-898a-4e88-8367-3ffa42bf0d14", "tag": "876447a5-4914-447d-9445-4888cf15aa9a"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:42:18.904537 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-ad61e466-3646-4fe9-aa48-63391dbcb779 req-b991e2ff-22e4-4a7f-8ffb-ace0256a5ce6 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:18.905041 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-ad61e466-3646-4fe9-aa48-63391dbcb779 req-b991e2ff-22e4-4a7f-8ffb-ace0256a5ce6 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:18.916384 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-ad61e466-3646-4fe9-aa48-63391dbcb779 req-b991e2ff-22e4-4a7f-8ffb-ace0256a5ce6 service nova] Creating event network-changed:876447a5-4914-447d-9445-4888cf15aa9a for instance 846b1b54-898a-4e88-8367-3ffa42bf0d14 on hv-cinder-84617 Jun 23 22:42:18.921971 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-ad61e466-3646-4fe9-aa48-63391dbcb779 req-b991e2ff-22e4-4a7f-8ffb-ace0256a5ce6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030031 Jun 23 22:42:18.922635 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 317/654] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:42:23.330947 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-b4ef41c9-120f-4c7e-8a9e-8689f4f6c1bf tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:42:23.331517 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-b4ef41c9-120f-4c7e-8a9e-8689f4f6c1bf tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:23.338066 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-b4ef41c9-120f-4c7e-8a9e-8689f4f6c1bf tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:23.338501 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-b4ef41c9-120f-4c7e-8a9e-8689f4f6c1bf tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:23.339295 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-b4ef41c9-120f-4c7e-8a9e-8689f4f6c1bf tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:23.339718 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-b4ef41c9-120f-4c7e-8a9e-8689f4f6c1bf tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:23.361985 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.objects.instance [None req-b4ef41c9-120f-4c7e-8a9e-8689f4f6c1bf tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lazy-loading 'flavor' on Instance uuid 628515ea-c2f6-490f-a67d-13d0e97698ac {{(pid=124357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:42:23.432408 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-b4ef41c9-120f-4c7e-8a9e-8689f4f6c1bf tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "POST /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac/action" status: 202 len: 0 microversion: 2.1 time: 0.105001 Jun 23 22:42:23.432937 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 338/655] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Jun 23 22:42:23 2022] POST /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:42:23.445905 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-19e310d3-ab1a-4f2c-9aba-012bc0c56083 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:23.447130 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-19e310d3-ab1a-4f2c-9aba-012bc0c56083 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:23.456374 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-19e310d3-ab1a-4f2c-9aba-012bc0c56083 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:23.457248 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-19e310d3-ab1a-4f2c-9aba-012bc0c56083 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:23.458606 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-19e310d3-ab1a-4f2c-9aba-012bc0c56083 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:23.459474 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-19e310d3-ab1a-4f2c-9aba-012bc0c56083 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:23.598908 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-19e310d3-ab1a-4f2c-9aba-012bc0c56083 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:23.607192 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-19e310d3-ab1a-4f2c-9aba-012bc0c56083 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1567 microversion: 2.1 time: 0.168787 Jun 23 22:42:23.608126 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 318/656] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:23 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:24.323943 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-9ab90bb2-4276-41b0-9834-3ff101d7550f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:24.324997 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-9ab90bb2-4276-41b0-9834-3ff101d7550f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: 3125a0e6-6f0f-408b-8d73-08610945e52e] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:24.331168 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9ab90bb2-4276-41b0-9834-3ff101d7550f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:24.331731 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9ab90bb2-4276-41b0-9834-3ff101d7550f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:24.332389 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9ab90bb2-4276-41b0-9834-3ff101d7550f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:24.332818 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9ab90bb2-4276-41b0-9834-3ff101d7550f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:24.363350 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-9ab90bb2-4276-41b0-9834-3ff101d7550f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044323 Jun 23 22:42:24.363926 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 339/657] 10.222.0.43 () {58 vars in 1301 bytes} [Thu Jun 23 22:42:24 2022] GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:42:24.524743 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-95f6271f-45cb-41d7-abff-1583c29e9e19 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:24.525293 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-95f6271f-45cb-41d7-abff-1583c29e9e19 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: 3125a0e6-6f0f-408b-8d73-08610945e52e] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:24.532763 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-95f6271f-45cb-41d7-abff-1583c29e9e19 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:24.533318 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-95f6271f-45cb-41d7-abff-1583c29e9e19 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:24.533953 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-95f6271f-45cb-41d7-abff-1583c29e9e19 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:24.534375 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-95f6271f-45cb-41d7-abff-1583c29e9e19 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:24.562788 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-95f6271f-45cb-41d7-abff-1583c29e9e19 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e/os-volume_attachments/24103e16-0115-4e9c-92d5-d60afe59e8ab" status: 200 len: 194 microversion: 2.1 time: 0.041997 Jun 23 22:42:24.563395 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 319/658] 10.222.0.43 () {58 vars in 1412 bytes} [Thu Jun 23 22:42:24 2022] GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e/os-volume_attachments/24103e16-0115-4e9c-92d5-d60afe59e8ab => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:42:24.573385 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-a45a653c-5849-4aa4-b720-bee7d21f804f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:24.573920 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-a45a653c-5849-4aa4-b720-bee7d21f804f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: 3125a0e6-6f0f-408b-8d73-08610945e52e] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:24.579928 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a45a653c-5849-4aa4-b720-bee7d21f804f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:24.580371 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a45a653c-5849-4aa4-b720-bee7d21f804f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:24.581121 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a45a653c-5849-4aa4-b720-bee7d21f804f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:24.581551 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a45a653c-5849-4aa4-b720-bee7d21f804f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:24.624451 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d36d6c64-716c-4b51-bf6f-89c8ae6433b5 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:24.625150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-d36d6c64-716c-4b51-bf6f-89c8ae6433b5 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:24.631196 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d36d6c64-716c-4b51-bf6f-89c8ae6433b5 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:24.631642 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d36d6c64-716c-4b51-bf6f-89c8ae6433b5 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:24.632407 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d36d6c64-716c-4b51-bf6f-89c8ae6433b5 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:24.632842 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d36d6c64-716c-4b51-bf6f-89c8ae6433b5 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:24.661340 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.objects.instance [None req-a45a653c-5849-4aa4-b720-bee7d21f804f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lazy-loading 'services' on Instance uuid 3125a0e6-6f0f-408b-8d73-08610945e52e {{(pid=124357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:42:24.737156 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-a45a653c-5849-4aa4-b720-bee7d21f804f tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e/os-volume_attachments/24103e16-0115-4e9c-92d5-d60afe59e8ab" status: 202 len: 0 microversion: 2.1 time: 0.167705 Jun 23 22:42:24.737786 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 340/659] 10.222.0.43 () {58 vars in 1415 bytes} [Thu Jun 23 22:42:24 2022] DELETE /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e/os-volume_attachments/24103e16-0115-4e9c-92d5-d60afe59e8ab => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:42:24.769804 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d36d6c64-716c-4b51-bf6f-89c8ae6433b5 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:24.779709 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d36d6c64-716c-4b51-bf6f-89c8ae6433b5 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1567 microversion: 2.1 time: 0.158998 Jun 23 22:42:24.780302 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 320/660] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:24 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:42:25.798834 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-af321f2a-44a4-4f31-ad12-614c4155f0a9 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:25.799571 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-af321f2a-44a4-4f31-ad12-614c4155f0a9 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:25.806748 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-af321f2a-44a4-4f31-ad12-614c4155f0a9 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:25.807228 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-af321f2a-44a4-4f31-ad12-614c4155f0a9 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:25.808675 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-af321f2a-44a4-4f31-ad12-614c4155f0a9 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:25.809137 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-af321f2a-44a4-4f31-ad12-614c4155f0a9 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:25.951293 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-af321f2a-44a4-4f31-ad12-614c4155f0a9 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:25.959044 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-af321f2a-44a4-4f31-ad12-614c4155f0a9 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1567 microversion: 2.1 time: 0.164725 Jun 23 22:42:25.959615 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 341/661] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:25 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:26.907464 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-de69a3d9-d24b-406c-a624-ea52dcadd760 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:26.907950 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-de69a3d9-d24b-406c-a624-ea52dcadd760 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: 3125a0e6-6f0f-408b-8d73-08610945e52e] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:26.910323 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:42:26.915757 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-de69a3d9-d24b-406c-a624-ea52dcadd760 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:26.916190 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-de69a3d9-d24b-406c-a624-ea52dcadd760 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:26.916989 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-de69a3d9-d24b-406c-a624-ea52dcadd760 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:26.917434 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-de69a3d9-d24b-406c-a624-ea52dcadd760 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:26.946070 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-de69a3d9-d24b-406c-a624-ea52dcadd760 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e/os-volume_attachments/862a0e35-6eac-4b32-90bf-9c9d76ec7f00" status: 200 len: 194 microversion: 2.1 time: 0.042415 Jun 23 22:42:26.946647 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 321/662] 10.222.0.43 () {58 vars in 1412 bytes} [Thu Jun 23 22:42:26 2022] GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e/os-volume_attachments/862a0e35-6eac-4b32-90bf-9c9d76ec7f00 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:42:26.957507 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-95e922ca-7dc2-4c0b-a0d6-06199a8d6656 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:26.958010 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-95e922ca-7dc2-4c0b-a0d6-06199a8d6656 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: 3125a0e6-6f0f-408b-8d73-08610945e52e] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:26.964542 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-95e922ca-7dc2-4c0b-a0d6-06199a8d6656 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:26.964991 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-95e922ca-7dc2-4c0b-a0d6-06199a8d6656 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:26.965749 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-95e922ca-7dc2-4c0b-a0d6-06199a8d6656 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:26.966181 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-95e922ca-7dc2-4c0b-a0d6-06199a8d6656 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:26.976019 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-7c0b7421-7e28-44be-8b83-b9955c368f2b tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:26.976628 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-7c0b7421-7e28-44be-8b83-b9955c368f2b tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:26.983028 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7c0b7421-7e28-44be-8b83-b9955c368f2b tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:26.983474 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7c0b7421-7e28-44be-8b83-b9955c368f2b tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:26.984234 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7c0b7421-7e28-44be-8b83-b9955c368f2b tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:26.984664 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7c0b7421-7e28-44be-8b83-b9955c368f2b tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:27.046309 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.objects.instance [None req-95e922ca-7dc2-4c0b-a0d6-06199a8d6656 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lazy-loading 'services' on Instance uuid 3125a0e6-6f0f-408b-8d73-08610945e52e {{(pid=124357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:42:27.128538 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-7c0b7421-7e28-44be-8b83-b9955c368f2b tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:27.137593 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-95e922ca-7dc2-4c0b-a0d6-06199a8d6656 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e/os-volume_attachments/862a0e35-6eac-4b32-90bf-9c9d76ec7f00" status: 202 len: 0 microversion: 2.1 time: 0.183683 Jun 23 22:42:27.138493 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 342/663] 10.222.0.43 () {58 vars in 1415 bytes} [Thu Jun 23 22:42:26 2022] DELETE /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e/os-volume_attachments/862a0e35-6eac-4b32-90bf-9c9d76ec7f00 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:42:27.142599 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-7c0b7421-7e28-44be-8b83-b9955c368f2b tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1567 microversion: 2.1 time: 0.170179 Jun 23 22:42:27.143567 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 322/664] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:26 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:42:28.161425 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-f83c3d45-ad3f-43ba-b01e-bd526c5844cd tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:28.162120 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-f83c3d45-ad3f-43ba-b01e-bd526c5844cd tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:28.164097 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:42:28.169791 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f83c3d45-ad3f-43ba-b01e-bd526c5844cd tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:28.170246 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f83c3d45-ad3f-43ba-b01e-bd526c5844cd tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:28.171015 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f83c3d45-ad3f-43ba-b01e-bd526c5844cd tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:28.171445 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f83c3d45-ad3f-43ba-b01e-bd526c5844cd tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:28.299925 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c5332960-b428-41e7-9b08-ddd8eb183e77 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:28.300896 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c5332960-b428-41e7-9b08-ddd8eb183e77 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: 3125a0e6-6f0f-408b-8d73-08610945e52e] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:28.307283 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c5332960-b428-41e7-9b08-ddd8eb183e77 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:28.308269 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c5332960-b428-41e7-9b08-ddd8eb183e77 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:28.308398 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-f83c3d45-ad3f-43ba-b01e-bd526c5844cd tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:28.309027 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c5332960-b428-41e7-9b08-ddd8eb183e77 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:28.309453 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c5332960-b428-41e7-9b08-ddd8eb183e77 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:28.315909 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-f83c3d45-ad3f-43ba-b01e-bd526c5844cd tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1567 microversion: 2.1 time: 0.159165 Jun 23 22:42:28.316483 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 343/665] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:28 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:28.338432 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c5332960-b428-41e7-9b08-ddd8eb183e77 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042358 Jun 23 22:42:28.339180 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 323/666] 10.222.0.43 () {58 vars in 1301 bytes} [Thu Jun 23 22:42:28 2022] GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 22:42:28.441705 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-7cdd3ece-8b0b-480c-837c-81c1f45106e5 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:28.442670 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-7cdd3ece-8b0b-480c-837c-81c1f45106e5 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: 3125a0e6-6f0f-408b-8d73-08610945e52e] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:28.448895 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7cdd3ece-8b0b-480c-837c-81c1f45106e5 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:28.449333 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7cdd3ece-8b0b-480c-837c-81c1f45106e5 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:28.450087 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7cdd3ece-8b0b-480c-837c-81c1f45106e5 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:28.450512 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7cdd3ece-8b0b-480c-837c-81c1f45106e5 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:28.479314 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-7cdd3ece-8b0b-480c-837c-81c1f45106e5 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041318 Jun 23 22:42:28.479883 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 344/667] 10.222.0.43 () {58 vars in 1301 bytes} [Thu Jun 23 22:42:28 2022] GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 22:42:28.544025 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-38371705-83f5-4ab6-a7b5-0c613ff9d1b3 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:28.544513 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-38371705-83f5-4ab6-a7b5-0c613ff9d1b3 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: 3125a0e6-6f0f-408b-8d73-08610945e52e] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:28.550455 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-38371705-83f5-4ab6-a7b5-0c613ff9d1b3 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:28.550890 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-38371705-83f5-4ab6-a7b5-0c613ff9d1b3 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:28.551665 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-38371705-83f5-4ab6-a7b5-0c613ff9d1b3 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:28.552088 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-38371705-83f5-4ab6-a7b5-0c613ff9d1b3 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:28.577103 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-38371705-83f5-4ab6-a7b5-0c613ff9d1b3 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: 3125a0e6-6f0f-408b-8d73-08610945e52e] Going to try to terminate instance {{(pid=124358) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:42:28.609779 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:42:28.651774 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-38371705-83f5-4ab6-a7b5-0c613ff9d1b3 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e" status: 204 len: 0 microversion: 2.1 time: 0.112665 Jun 23 22:42:28.652598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 324/668] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 23 22:42:28 2022] DELETE /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 22:42:28.660970 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-cc815ad4-19b1-4f97-bb83-5c4c39615305 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:28.661579 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-cc815ad4-19b1-4f97-bb83-5c4c39615305 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: 3125a0e6-6f0f-408b-8d73-08610945e52e] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:28.668395 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-cc815ad4-19b1-4f97-bb83-5c4c39615305 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:28.668846 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-cc815ad4-19b1-4f97-bb83-5c4c39615305 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:28.669602 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-cc815ad4-19b1-4f97-bb83-5c4c39615305 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:28.670036 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-cc815ad4-19b1-4f97-bb83-5c4c39615305 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:28.796993 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-cc815ad4-19b1-4f97-bb83-5c4c39615305 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:28.804400 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-cc815ad4-19b1-4f97-bb83-5c4c39615305 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e" status: 200 len: 1675 microversion: 2.1 time: 0.147368 Jun 23 22:42:28.804959 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 345/669] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:28 2022] GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:29.333426 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-db909289-3f96-4d59-9413-9ada54b94105 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:29.334120 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-db909289-3f96-4d59-9413-9ada54b94105 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:29.340617 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-db909289-3f96-4d59-9413-9ada54b94105 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:29.341053 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-db909289-3f96-4d59-9413-9ada54b94105 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:29.341797 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-db909289-3f96-4d59-9413-9ada54b94105 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:29.342218 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-db909289-3f96-4d59-9413-9ada54b94105 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:29.473269 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-db909289-3f96-4d59-9413-9ada54b94105 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:29.480743 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-db909289-3f96-4d59-9413-9ada54b94105 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1567 microversion: 2.1 time: 0.151553 Jun 23 22:42:29.481320 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 325/670] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:29 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:29.822230 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-f72757b7-f89a-486e-971f-3ed09652d496 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:29.822845 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-f72757b7-f89a-486e-971f-3ed09652d496 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: 3125a0e6-6f0f-408b-8d73-08610945e52e] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:29.829619 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f72757b7-f89a-486e-971f-3ed09652d496 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:29.830065 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f72757b7-f89a-486e-971f-3ed09652d496 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:29.830822 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f72757b7-f89a-486e-971f-3ed09652d496 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:29.831285 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f72757b7-f89a-486e-971f-3ed09652d496 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:29.960825 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-f72757b7-f89a-486e-971f-3ed09652d496 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:29.968839 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-f72757b7-f89a-486e-971f-3ed09652d496 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e" status: 200 len: 1675 microversion: 2.1 time: 0.150454 Jun 23 22:42:29.969400 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 346/671] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:29 2022] GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:30.497987 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-39812b47-2a30-4873-b9cf-9c8a48a0db88 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:30.498615 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-39812b47-2a30-4873-b9cf-9c8a48a0db88 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:30.505032 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-39812b47-2a30-4873-b9cf-9c8a48a0db88 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:30.505471 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-39812b47-2a30-4873-b9cf-9c8a48a0db88 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:30.506219 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-39812b47-2a30-4873-b9cf-9c8a48a0db88 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:30.506643 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-39812b47-2a30-4873-b9cf-9c8a48a0db88 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:30.632905 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-39812b47-2a30-4873-b9cf-9c8a48a0db88 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:30.640930 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-39812b47-2a30-4873-b9cf-9c8a48a0db88 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1567 microversion: 2.1 time: 0.147319 Jun 23 22:42:30.641489 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 326/672] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:30 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:30.986707 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-70e34768-679b-41ee-8df6-6354f796511c tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:30.987320 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-70e34768-679b-41ee-8df6-6354f796511c tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: 3125a0e6-6f0f-408b-8d73-08610945e52e] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:30.993708 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-70e34768-679b-41ee-8df6-6354f796511c tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:30.994151 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-70e34768-679b-41ee-8df6-6354f796511c tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:30.994960 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-70e34768-679b-41ee-8df6-6354f796511c tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:30.996393 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-70e34768-679b-41ee-8df6-6354f796511c tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:31.126541 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-70e34768-679b-41ee-8df6-6354f796511c tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:31.134158 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-70e34768-679b-41ee-8df6-6354f796511c tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e" status: 200 len: 1675 microversion: 2.1 time: 0.151326 Jun 23 22:42:31.134715 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 347/673] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:30 2022] GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:31.657533 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-4ada6fc8-9507-4143-9737-19ecb73f5d3a tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:31.658138 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-4ada6fc8-9507-4143-9737-19ecb73f5d3a tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:31.664572 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4ada6fc8-9507-4143-9737-19ecb73f5d3a tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:31.665267 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4ada6fc8-9507-4143-9737-19ecb73f5d3a tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:31.666013 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4ada6fc8-9507-4143-9737-19ecb73f5d3a tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:31.666439 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4ada6fc8-9507-4143-9737-19ecb73f5d3a tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:31.883803 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4ada6fc8-9507-4143-9737-19ecb73f5d3a tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:31.891334 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-4ada6fc8-9507-4143-9737-19ecb73f5d3a tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1567 microversion: 2.1 time: 0.237570 Jun 23 22:42:31.891919 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 327/674] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:31 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1567 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:32.152516 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-73a0086d-9773-479c-bdda-56d964f235a4 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:32.153127 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-73a0086d-9773-479c-bdda-56d964f235a4 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: 3125a0e6-6f0f-408b-8d73-08610945e52e] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:32.159462 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-73a0086d-9773-479c-bdda-56d964f235a4 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:32.159896 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-73a0086d-9773-479c-bdda-56d964f235a4 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:32.160644 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-73a0086d-9773-479c-bdda-56d964f235a4 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:32.161070 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-73a0086d-9773-479c-bdda-56d964f235a4 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:32.346181 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-73a0086d-9773-479c-bdda-56d964f235a4 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53284773f7a430db3d0e16d3c2cd262', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c751cc6b8ac64f3fb7adc9bc71575bd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:32.354190 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-73a0086d-9773-479c-bdda-56d964f235a4 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e" status: 200 len: 1675 microversion: 2.1 time: 0.206311 Jun 23 22:42:32.355137 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 348/675] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:32 2022] GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e => generated 1675 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:32.654096 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-147a2653-a0c5-4880-b847-97a2bfbf2f0e req-c212f0df-cadd-49ac-97dd-bf5d5a95f81a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3125a0e6-6f0f-408b-8d73-08610945e52e", "name": "network-vif-deleted", "tag": "60973a16-fee9-49ee-acd2-8876865316c0"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:42:32.662889 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-147a2653-a0c5-4880-b847-97a2bfbf2f0e req-c212f0df-cadd-49ac-97dd-bf5d5a95f81a service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:32.663566 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-147a2653-a0c5-4880-b847-97a2bfbf2f0e req-c212f0df-cadd-49ac-97dd-bf5d5a95f81a service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:32.677351 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-147a2653-a0c5-4880-b847-97a2bfbf2f0e req-c212f0df-cadd-49ac-97dd-bf5d5a95f81a service nova] Creating event network-vif-deleted:60973a16-fee9-49ee-acd2-8876865316c0 for instance 3125a0e6-6f0f-408b-8d73-08610945e52e on hv-cinder-84617 Jun 23 22:42:32.682264 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-147a2653-a0c5-4880-b847-97a2bfbf2f0e req-c212f0df-cadd-49ac-97dd-bf5d5a95f81a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033511 Jun 23 22:42:32.684006 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 328/676] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:42:32.908554 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-fadf4271-fa50-4b57-aeb6-8c0669a45454 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:32.909266 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-fadf4271-fa50-4b57-aeb6-8c0669a45454 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:32.915734 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fadf4271-fa50-4b57-aeb6-8c0669a45454 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:32.916262 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fadf4271-fa50-4b57-aeb6-8c0669a45454 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:32.917728 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fadf4271-fa50-4b57-aeb6-8c0669a45454 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:32.918258 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fadf4271-fa50-4b57-aeb6-8c0669a45454 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:33.051205 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-fadf4271-fa50-4b57-aeb6-8c0669a45454 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:33.059090 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-fadf4271-fa50-4b57-aeb6-8c0669a45454 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1567 microversion: 2.1 time: 0.154465 Jun 23 22:42:33.059677 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 349/677] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:32 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:33.373321 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-95657757-c510-4132-a3c4-086fde7c7af2 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:33.374181 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-95657757-c510-4132-a3c4-086fde7c7af2 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: 3125a0e6-6f0f-408b-8d73-08610945e52e] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:33.380880 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-95657757-c510-4132-a3c4-086fde7c7af2 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:33.381236 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-95657757-c510-4132-a3c4-086fde7c7af2 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:33.382029 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-95657757-c510-4132-a3c4-086fde7c7af2 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:33.382478 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-95657757-c510-4132-a3c4-086fde7c7af2 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:33.396619 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-95657757-c510-4132-a3c4-086fde7c7af2 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] HTTP exception thrown: Instance 3125a0e6-6f0f-408b-8d73-08610945e52e could not be found. Jun 23 22:42:33.398263 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-95657757-c510-4132-a3c4-086fde7c7af2 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Request method failure captured: Jun 23 22:42:33.398263 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: request: GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e HTTP/1.1 Jun 23 22:42:33.398263 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept: application/json Jun 23 22:42:33.398263 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Jun 23 22:42:33.398263 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Connection: close Jun 23 22:42:33.398263 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Length: 0 Jun 23 22:42:33.398263 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Type: application/json Jun 23 22:42:33.398263 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Host: 10.222.0.43 Jun 23 22:42:33.398263 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Jun 23 22:42:33.398263 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.9 Jun 23 22:42:33.398263 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABitOrNxmV92J7HcqRKDnbLLScwyCGv0L9ksVybP612zzZsPH1Fbo95rUcrWObQOTNcnKOBO9s7WMb5HMS3lEYgs7t-huHaMcgwnmI7nPnFqhsw99NVC0fqD2NaTOhENFcPEMHt9sAMGbvh7mmigmY8jxF5vcH9XQyBSAlnhZd8-aA7Z_o Jun 23 22:42:33.398263 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Jun 23 22:42:33.398263 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Jun 23 22:42:33.398263 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Jun 23 22:42:33.398263 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Jun 23 22:42:33.398263 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Jun 23 22:42:33.398263 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Jun 23 22:42:33.398263 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Id: c751cc6b8ac64f3fb7adc9bc71575bd2 Jun 23 22:42:33.398263 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-AttachVolumeTestJSON-545622694 Jun 23 22:42:33.398263 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Role: reader,member Jun 23 22:42:33.398263 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Roles: reader,member Jun 23 22:42:33.399960 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c751cc6b8ac64f3fb7adc9bc71575bd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c751cc6b8ac64f3fb7adc9bc71575bd2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c751cc6b8ac64f3fb7adc9bc71575bd2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c751cc6b8ac64f3fb7adc9bc71575bd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:42:33.399960 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-AttachVolumeTestJSON-545622694 Jun 23 22:42:33.399960 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Id: c751cc6b8ac64f3fb7adc9bc71575bd2 Jun 23 22:42:33.399960 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-AttachVolumeTestJSON-545622694 Jun 23 22:42:33.399960 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User: tempest-AttachVolumeTestJSON-545622694-project Jun 23 22:42:33.399960 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Jun 23 22:42:33.399960 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Jun 23 22:42:33.399960 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Id: f53284773f7a430db3d0e16d3c2cd262 Jun 23 22:42:33.399960 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-AttachVolumeTestJSON-545622694-project Jun 23 22:42:33.399960 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: method: > Jun 23 22:42:33.399960 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: exception: Instance 3125a0e6-6f0f-408b-8d73-08610945e52e could not be found. Jun 23 22:42:33.399960 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: action_args: {'id': '3125a0e6-6f0f-408b-8d73-08610945e52e'} Jun 23 22:42:33.404966 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:42:33.404966 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:42:33.404966 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:42:33.404966 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:42:33.404966 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:42:33.404966 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:42:33.404966 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:42:33.404966 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:42:33.404966 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:42:33.404966 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:42:33.404966 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3125a0e6-6f0f-408b-8d73-08610945e52e could not be found. Jun 23 22:42:33.404966 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:42:33.404966 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:42:33.404966 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:42:33.404966 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:42:33.404966 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:42:33.404966 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:42:33.404966 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:42:33.404966 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:42:33.404966 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:42:33.407069 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:42:33.407069 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:42:33.407069 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:42:33.407069 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:42:33.407069 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:42:33.407069 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:42:33.407069 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:42:33.407069 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3125a0e6-6f0f-408b-8d73-08610945e52e could not be found. Jun 23 22:42:33.407069 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:42:33.407069 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:42:33.407069 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:42:33.407069 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:42:33.407069 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:42:33.407069 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:42:33.407069 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:42:33.407069 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:42:33.407069 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3125a0e6-6f0f-408b-8d73-08610945e52e could not be found. Jun 23 22:42:33.407069 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:42:33.408430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-95657757-c510-4132-a3c4-086fde7c7af2 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Returning 404 to user: Instance 3125a0e6-6f0f-408b-8d73-08610945e52e could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:42:33.408430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-95657757-c510-4132-a3c4-086fde7c7af2 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e" status: 404 len: 111 microversion: 2.1 time: 0.031521 Jun 23 22:42:33.408430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 329/678] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:33 2022] GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:42:33.409390 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-f89a53a6-f204-4f01-91aa-d1a82079503d tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '.version_select at 0x7fb7197a60d0>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:33.427834 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-f89a53a6-f204-4f01-91aa-d1a82079503d tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2099321125" status: 202 len: 0 microversion: 2.1 time: 0.022108 Jun 23 22:42:33.431587 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 350/679] 10.222.0.43 () {58 vars in 1220 bytes} [Thu Jun 23 22:42:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2099321125 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:42:34.076652 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a51e46c1-822c-418c-a0e6-73f3510a0b45 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:34.077252 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-a51e46c1-822c-418c-a0e6-73f3510a0b45 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:34.084133 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a51e46c1-822c-418c-a0e6-73f3510a0b45 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:34.084568 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a51e46c1-822c-418c-a0e6-73f3510a0b45 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:34.085340 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a51e46c1-822c-418c-a0e6-73f3510a0b45 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:34.085762 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a51e46c1-822c-418c-a0e6-73f3510a0b45 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:34.414655 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-a51e46c1-822c-418c-a0e6-73f3510a0b45 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:34.423026 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-a51e46c1-822c-418c-a0e6-73f3510a0b45 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1567 microversion: 2.1 time: 0.350903 Jun 23 22:42:34.423649 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 330/680] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:34 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1567 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:35.440524 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-81a7cc6a-9480-4209-b6ae-a0a0d680e400 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:35.441068 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-81a7cc6a-9480-4209-b6ae-a0a0d680e400 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:35.447118 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-81a7cc6a-9480-4209-b6ae-a0a0d680e400 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:35.447560 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-81a7cc6a-9480-4209-b6ae-a0a0d680e400 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:35.448943 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-81a7cc6a-9480-4209-b6ae-a0a0d680e400 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:35.449522 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-81a7cc6a-9480-4209-b6ae-a0a0d680e400 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:35.598815 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-81a7cc6a-9480-4209-b6ae-a0a0d680e400 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:35.602338 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:42:35.608128 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-81a7cc6a-9480-4209-b6ae-a0a0d680e400 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1567 microversion: 2.1 time: 0.172075 Jun 23 22:42:35.608693 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 351/681] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:35 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:36.625456 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-2a6e7738-a528-4c7c-9e52-fc206bccdc10 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:36.626065 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-2a6e7738-a528-4c7c-9e52-fc206bccdc10 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:36.635410 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2a6e7738-a528-4c7c-9e52-fc206bccdc10 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:36.635410 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2a6e7738-a528-4c7c-9e52-fc206bccdc10 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:36.635410 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2a6e7738-a528-4c7c-9e52-fc206bccdc10 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:36.635410 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2a6e7738-a528-4c7c-9e52-fc206bccdc10 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:36.640500 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-514216ac-013b-453c-8a8a-cbed91ad0ec2 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:36.640977 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-514216ac-013b-453c-8a8a-cbed91ad0ec2 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: 3125a0e6-6f0f-408b-8d73-08610945e52e] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:36.648616 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-514216ac-013b-453c-8a8a-cbed91ad0ec2 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:36.649063 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-514216ac-013b-453c-8a8a-cbed91ad0ec2 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:36.649828 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-514216ac-013b-453c-8a8a-cbed91ad0ec2 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:36.650449 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-514216ac-013b-453c-8a8a-cbed91ad0ec2 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:36.665535 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.wsgi [None req-514216ac-013b-453c-8a8a-cbed91ad0ec2 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] HTTP exception thrown: Instance 3125a0e6-6f0f-408b-8d73-08610945e52e could not be found. Jun 23 22:42:36.668069 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-514216ac-013b-453c-8a8a-cbed91ad0ec2 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Request method failure captured: Jun 23 22:42:36.668069 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: request: DELETE /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e HTTP/1.1 Jun 23 22:42:36.668069 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept: application/json Jun 23 22:42:36.668069 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept-Encoding: identity Jun 23 22:42:36.668069 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Connection: close Jun 23 22:42:36.668069 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Length: 0 Jun 23 22:42:36.668069 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Type: application/json Jun 23 22:42:36.668069 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Host: 10.222.0.43 Jun 23 22:42:36.668069 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Openstack-System-Scope: None Jun 23 22:42:36.668069 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: User-Agent: python-urllib3/1.26.9 Jun 23 22:42:36.668069 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Auth-Token: gAAAAABitOrNxmV92J7HcqRKDnbLLScwyCGv0L9ksVybP612zzZsPH1Fbo95rUcrWObQOTNcnKOBO9s7WMb5HMS3lEYgs7t-huHaMcgwnmI7nPnFqhsw99NVC0fqD2NaTOhENFcPEMHt9sAMGbvh7mmigmY8jxF5vcH9XQyBSAlnhZd8-aA7Z_o Jun 23 22:42:36.668069 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Id: None Jun 23 22:42:36.668069 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Name: None Jun 23 22:42:36.668069 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Identity-Status: Confirmed Jun 23 22:42:36.668069 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Is-Admin-Project: True Jun 23 22:42:36.668069 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Id: default Jun 23 22:42:36.668069 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Name: Default Jun 23 22:42:36.668069 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Id: c751cc6b8ac64f3fb7adc9bc71575bd2 Jun 23 22:42:36.668069 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Name: tempest-AttachVolumeTestJSON-545622694 Jun 23 22:42:36.668069 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Role: reader,member Jun 23 22:42:36.668069 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Roles: reader,member Jun 23 22:42:36.669653 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c751cc6b8ac64f3fb7adc9bc71575bd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c751cc6b8ac64f3fb7adc9bc71575bd2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c751cc6b8ac64f3fb7adc9bc71575bd2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c751cc6b8ac64f3fb7adc9bc71575bd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:42:36.669653 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant: tempest-AttachVolumeTestJSON-545622694 Jun 23 22:42:36.669653 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Id: c751cc6b8ac64f3fb7adc9bc71575bd2 Jun 23 22:42:36.669653 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Name: tempest-AttachVolumeTestJSON-545622694 Jun 23 22:42:36.669653 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User: tempest-AttachVolumeTestJSON-545622694-project Jun 23 22:42:36.669653 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Id: default Jun 23 22:42:36.669653 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Name: Default Jun 23 22:42:36.669653 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Id: f53284773f7a430db3d0e16d3c2cd262 Jun 23 22:42:36.669653 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Name: tempest-AttachVolumeTestJSON-545622694-project Jun 23 22:42:36.669653 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: method: > Jun 23 22:42:36.669653 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: exception: Instance 3125a0e6-6f0f-408b-8d73-08610945e52e could not be found. Jun 23 22:42:36.669653 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: action_args: {'id': '3125a0e6-6f0f-408b-8d73-08610945e52e'} Jun 23 22:42:36.670666 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:42:36.670666 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:42:36.670666 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:42:36.670666 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:42:36.670666 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:42:36.670666 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:42:36.670666 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:42:36.670666 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:42:36.670666 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:42:36.670666 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:42:36.670666 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3125a0e6-6f0f-408b-8d73-08610945e52e could not be found. Jun 23 22:42:36.670666 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:42:36.670666 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:42:36.670666 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:42:36.670666 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:42:36.670666 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:42:36.670666 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:42:36.670666 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:42:36.670666 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:42:36.670666 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:42:36.671992 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:42:36.671992 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 22:42:36.671992 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 22:42:36.671992 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 22:42:36.671992 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 22:42:36.671992 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:42:36.671992 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:42:36.671992 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:42:36.671992 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:42:36.671992 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3125a0e6-6f0f-408b-8d73-08610945e52e could not be found. Jun 23 22:42:36.671992 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:42:36.671992 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:42:36.671992 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:42:36.671992 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:42:36.671992 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:42:36.671992 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:42:36.671992 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:42:36.671992 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:42:36.671992 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3125a0e6-6f0f-408b-8d73-08610945e52e could not be found. Jun 23 22:42:36.671992 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:42:36.673290 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-514216ac-013b-453c-8a8a-cbed91ad0ec2 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Returning 404 to user: Instance 3125a0e6-6f0f-408b-8d73-08610945e52e could not be found. {{(pid=124357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:42:36.673290 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-514216ac-013b-453c-8a8a-cbed91ad0ec2 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e" status: 404 len: 111 microversion: 2.1 time: 0.032878 Jun 23 22:42:36.673290 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 352/682] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 23 22:42:36 2022] DELETE /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 22:42:36.677413 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-bd394600-b69d-4142-b76e-3c0bd0c026b1 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:36.678022 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-bd394600-b69d-4142-b76e-3c0bd0c026b1 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: 3125a0e6-6f0f-408b-8d73-08610945e52e] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:36.684141 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-bd394600-b69d-4142-b76e-3c0bd0c026b1 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:36.684590 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-bd394600-b69d-4142-b76e-3c0bd0c026b1 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:36.685355 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-bd394600-b69d-4142-b76e-3c0bd0c026b1 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:36.685787 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-bd394600-b69d-4142-b76e-3c0bd0c026b1 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:36.699355 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.wsgi [None req-bd394600-b69d-4142-b76e-3c0bd0c026b1 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] HTTP exception thrown: Instance 3125a0e6-6f0f-408b-8d73-08610945e52e could not be found. Jun 23 22:42:36.700890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-bd394600-b69d-4142-b76e-3c0bd0c026b1 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Request method failure captured: Jun 23 22:42:36.700890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: request: GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e HTTP/1.1 Jun 23 22:42:36.700890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept: application/json Jun 23 22:42:36.700890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept-Encoding: identity Jun 23 22:42:36.700890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Connection: close Jun 23 22:42:36.700890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Length: 0 Jun 23 22:42:36.700890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Type: application/json Jun 23 22:42:36.700890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Host: 10.222.0.43 Jun 23 22:42:36.700890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Openstack-System-Scope: None Jun 23 22:42:36.700890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: User-Agent: python-urllib3/1.26.9 Jun 23 22:42:36.700890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Auth-Token: gAAAAABitOrNxmV92J7HcqRKDnbLLScwyCGv0L9ksVybP612zzZsPH1Fbo95rUcrWObQOTNcnKOBO9s7WMb5HMS3lEYgs7t-huHaMcgwnmI7nPnFqhsw99NVC0fqD2NaTOhENFcPEMHt9sAMGbvh7mmigmY8jxF5vcH9XQyBSAlnhZd8-aA7Z_o Jun 23 22:42:36.700890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Id: None Jun 23 22:42:36.700890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Name: None Jun 23 22:42:36.700890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Identity-Status: Confirmed Jun 23 22:42:36.700890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Is-Admin-Project: True Jun 23 22:42:36.700890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Id: default Jun 23 22:42:36.700890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Name: Default Jun 23 22:42:36.700890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Id: c751cc6b8ac64f3fb7adc9bc71575bd2 Jun 23 22:42:36.700890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Name: tempest-AttachVolumeTestJSON-545622694 Jun 23 22:42:36.700890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Role: reader,member Jun 23 22:42:36.700890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Roles: reader,member Jun 23 22:42:36.702486 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c751cc6b8ac64f3fb7adc9bc71575bd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c751cc6b8ac64f3fb7adc9bc71575bd2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c751cc6b8ac64f3fb7adc9bc71575bd2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c751cc6b8ac64f3fb7adc9bc71575bd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:42:36.702486 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant: tempest-AttachVolumeTestJSON-545622694 Jun 23 22:42:36.702486 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Id: c751cc6b8ac64f3fb7adc9bc71575bd2 Jun 23 22:42:36.702486 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Name: tempest-AttachVolumeTestJSON-545622694 Jun 23 22:42:36.702486 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User: tempest-AttachVolumeTestJSON-545622694-project Jun 23 22:42:36.702486 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Id: default Jun 23 22:42:36.702486 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Name: Default Jun 23 22:42:36.702486 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Id: f53284773f7a430db3d0e16d3c2cd262 Jun 23 22:42:36.702486 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Name: tempest-AttachVolumeTestJSON-545622694-project Jun 23 22:42:36.702486 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: method: > Jun 23 22:42:36.702486 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: exception: Instance 3125a0e6-6f0f-408b-8d73-08610945e52e could not be found. Jun 23 22:42:36.702486 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: action_args: {'id': '3125a0e6-6f0f-408b-8d73-08610945e52e'} Jun 23 22:42:36.703625 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:42:36.703625 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:42:36.703625 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:42:36.703625 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:42:36.703625 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:42:36.703625 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:42:36.703625 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:42:36.703625 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:42:36.703625 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:42:36.703625 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:42:36.703625 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3125a0e6-6f0f-408b-8d73-08610945e52e could not be found. Jun 23 22:42:36.703625 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:42:36.703625 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:42:36.703625 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:42:36.703625 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:42:36.703625 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:42:36.703625 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:42:36.703625 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:42:36.703625 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:42:36.703625 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:42:36.704874 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:42:36.704874 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:42:36.704874 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:42:36.704874 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:42:36.704874 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:42:36.704874 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:42:36.704874 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:42:36.704874 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3125a0e6-6f0f-408b-8d73-08610945e52e could not be found. Jun 23 22:42:36.704874 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:42:36.704874 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:42:36.704874 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:42:36.704874 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:42:36.704874 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:42:36.704874 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:42:36.704874 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:42:36.704874 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:42:36.704874 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3125a0e6-6f0f-408b-8d73-08610945e52e could not be found. Jun 23 22:42:36.704874 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:42:36.706088 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-bd394600-b69d-4142-b76e-3c0bd0c026b1 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Returning 404 to user: Instance 3125a0e6-6f0f-408b-8d73-08610945e52e could not be found. {{(pid=124357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:42:36.706088 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-bd394600-b69d-4142-b76e-3c0bd0c026b1 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e" status: 404 len: 111 microversion: 2.1 time: 0.028458 Jun 23 22:42:36.706088 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 353/683] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:36 2022] GET /compute/v2.1/servers/3125a0e6-6f0f-408b-8d73-08610945e52e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 22:42:36.771453 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-2a6e7738-a528-4c7c-9e52-fc206bccdc10 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:36.779637 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-2a6e7738-a528-4c7c-9e52-fc206bccdc10 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1567 microversion: 2.1 time: 0.158186 Jun 23 22:42:36.780201 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 331/684] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:36 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:37.797426 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-4dde21a7-1428-4569-a192-2b8ddc739397 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:37.798033 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-4dde21a7-1428-4569-a192-2b8ddc739397 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:37.804539 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-4dde21a7-1428-4569-a192-2b8ddc739397 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:37.804973 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-4dde21a7-1428-4569-a192-2b8ddc739397 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:37.805723 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-4dde21a7-1428-4569-a192-2b8ddc739397 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:37.806163 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-4dde21a7-1428-4569-a192-2b8ddc739397 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:37.839955 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-79906186-ad12-4a80-9e7e-895b7ae50c33 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:37.840526 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-79906186-ad12-4a80-9e7e-895b7ae50c33 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:37.846958 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-79906186-ad12-4a80-9e7e-895b7ae50c33 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:37.847424 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-79906186-ad12-4a80-9e7e-895b7ae50c33 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:37.848178 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-79906186-ad12-4a80-9e7e-895b7ae50c33 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:37.848608 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-79906186-ad12-4a80-9e7e-895b7ae50c33 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:37.863555 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-79906186-ad12-4a80-9e7e-895b7ae50c33 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] HTTP exception thrown: Instance f910ba21-0126-4f09-8fd9-10f2365e67c1 could not be found. Jun 23 22:42:37.865099 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-79906186-ad12-4a80-9e7e-895b7ae50c33 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Request method failure captured: Jun 23 22:42:37.865099 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: request: DELETE /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 HTTP/1.1 Jun 23 22:42:37.865099 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept: application/json Jun 23 22:42:37.865099 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Jun 23 22:42:37.865099 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Connection: close Jun 23 22:42:37.865099 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Length: 0 Jun 23 22:42:37.865099 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Type: application/json Jun 23 22:42:37.865099 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Host: 10.222.0.43 Jun 23 22:42:37.865099 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Jun 23 22:42:37.865099 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.9 Jun 23 22:42:37.865099 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABitOrNxmV92J7HcqRKDnbLLScwyCGv0L9ksVybP612zzZsPH1Fbo95rUcrWObQOTNcnKOBO9s7WMb5HMS3lEYgs7t-huHaMcgwnmI7nPnFqhsw99NVC0fqD2NaTOhENFcPEMHt9sAMGbvh7mmigmY8jxF5vcH9XQyBSAlnhZd8-aA7Z_o Jun 23 22:42:37.865099 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Jun 23 22:42:37.865099 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Jun 23 22:42:37.865099 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Jun 23 22:42:37.865099 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Jun 23 22:42:37.865099 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Jun 23 22:42:37.865099 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Jun 23 22:42:37.865099 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Id: c751cc6b8ac64f3fb7adc9bc71575bd2 Jun 23 22:42:37.865099 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-AttachVolumeTestJSON-545622694 Jun 23 22:42:37.865099 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Role: reader,member Jun 23 22:42:37.865099 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Roles: reader,member Jun 23 22:42:37.866712 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c751cc6b8ac64f3fb7adc9bc71575bd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c751cc6b8ac64f3fb7adc9bc71575bd2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c751cc6b8ac64f3fb7adc9bc71575bd2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c751cc6b8ac64f3fb7adc9bc71575bd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:42:37.866712 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-AttachVolumeTestJSON-545622694 Jun 23 22:42:37.866712 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Id: c751cc6b8ac64f3fb7adc9bc71575bd2 Jun 23 22:42:37.866712 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-AttachVolumeTestJSON-545622694 Jun 23 22:42:37.866712 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User: tempest-AttachVolumeTestJSON-545622694-project Jun 23 22:42:37.866712 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Jun 23 22:42:37.866712 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Jun 23 22:42:37.866712 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Id: f53284773f7a430db3d0e16d3c2cd262 Jun 23 22:42:37.866712 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-AttachVolumeTestJSON-545622694-project Jun 23 22:42:37.866712 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: method: > Jun 23 22:42:37.866712 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: exception: Instance f910ba21-0126-4f09-8fd9-10f2365e67c1 could not be found. Jun 23 22:42:37.866712 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: action_args: {'id': 'f910ba21-0126-4f09-8fd9-10f2365e67c1'} Jun 23 22:42:37.867780 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:42:37.867780 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:42:37.867780 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:42:37.867780 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:42:37.867780 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:42:37.867780 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:42:37.867780 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:42:37.867780 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:42:37.867780 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:42:37.867780 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:42:37.867780 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f910ba21-0126-4f09-8fd9-10f2365e67c1 could not be found. Jun 23 22:42:37.867780 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:42:37.867780 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:42:37.867780 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:42:37.867780 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:42:37.867780 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:42:37.867780 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:42:37.867780 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:42:37.867780 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:42:37.867780 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:42:37.869257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:42:37.869257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 22:42:37.869257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 22:42:37.869257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 22:42:37.869257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 22:42:37.869257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:42:37.869257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:42:37.869257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:42:37.869257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:42:37.869257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f910ba21-0126-4f09-8fd9-10f2365e67c1 could not be found. Jun 23 22:42:37.869257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:42:37.869257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:42:37.869257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:42:37.869257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:42:37.869257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:42:37.869257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:42:37.869257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:42:37.869257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:42:37.869257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f910ba21-0126-4f09-8fd9-10f2365e67c1 could not be found. Jun 23 22:42:37.869257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:42:37.871452 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-79906186-ad12-4a80-9e7e-895b7ae50c33 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Returning 404 to user: Instance f910ba21-0126-4f09-8fd9-10f2365e67c1 could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:42:37.871452 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-79906186-ad12-4a80-9e7e-895b7ae50c33 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 404 len: 111 microversion: 2.1 time: 0.030843 Jun 23 22:42:37.871452 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 332/685] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 23 22:42:37 2022] DELETE /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 22:42:37.875293 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-030497b4-d0c7-4af5-9709-b029928f6523 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:37.875907 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-030497b4-d0c7-4af5-9709-b029928f6523 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] [instance: f910ba21-0126-4f09-8fd9-10f2365e67c1] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:37.881934 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-030497b4-d0c7-4af5-9709-b029928f6523 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:37.882367 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-030497b4-d0c7-4af5-9709-b029928f6523 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:37.883156 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-030497b4-d0c7-4af5-9709-b029928f6523 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:37.883583 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-030497b4-d0c7-4af5-9709-b029928f6523 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:37.897078 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-030497b4-d0c7-4af5-9709-b029928f6523 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] HTTP exception thrown: Instance f910ba21-0126-4f09-8fd9-10f2365e67c1 could not be found. Jun 23 22:42:37.898628 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-030497b4-d0c7-4af5-9709-b029928f6523 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Request method failure captured: Jun 23 22:42:37.898628 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: request: GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 HTTP/1.1 Jun 23 22:42:37.898628 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept: application/json Jun 23 22:42:37.898628 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Jun 23 22:42:37.898628 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Connection: close Jun 23 22:42:37.898628 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Length: 0 Jun 23 22:42:37.898628 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Type: application/json Jun 23 22:42:37.898628 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Host: 10.222.0.43 Jun 23 22:42:37.898628 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Jun 23 22:42:37.898628 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.9 Jun 23 22:42:37.898628 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABitOrNxmV92J7HcqRKDnbLLScwyCGv0L9ksVybP612zzZsPH1Fbo95rUcrWObQOTNcnKOBO9s7WMb5HMS3lEYgs7t-huHaMcgwnmI7nPnFqhsw99NVC0fqD2NaTOhENFcPEMHt9sAMGbvh7mmigmY8jxF5vcH9XQyBSAlnhZd8-aA7Z_o Jun 23 22:42:37.898628 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Jun 23 22:42:37.898628 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Jun 23 22:42:37.898628 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Jun 23 22:42:37.898628 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Jun 23 22:42:37.898628 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Jun 23 22:42:37.898628 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Jun 23 22:42:37.898628 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Id: c751cc6b8ac64f3fb7adc9bc71575bd2 Jun 23 22:42:37.898628 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-AttachVolumeTestJSON-545622694 Jun 23 22:42:37.898628 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Role: reader,member Jun 23 22:42:37.898628 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Roles: reader,member Jun 23 22:42:37.901081 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c751cc6b8ac64f3fb7adc9bc71575bd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c751cc6b8ac64f3fb7adc9bc71575bd2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c751cc6b8ac64f3fb7adc9bc71575bd2", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c751cc6b8ac64f3fb7adc9bc71575bd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:42:37.901081 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-AttachVolumeTestJSON-545622694 Jun 23 22:42:37.901081 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Id: c751cc6b8ac64f3fb7adc9bc71575bd2 Jun 23 22:42:37.901081 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-AttachVolumeTestJSON-545622694 Jun 23 22:42:37.901081 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User: tempest-AttachVolumeTestJSON-545622694-project Jun 23 22:42:37.901081 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Jun 23 22:42:37.901081 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Jun 23 22:42:37.901081 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Id: f53284773f7a430db3d0e16d3c2cd262 Jun 23 22:42:37.901081 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-AttachVolumeTestJSON-545622694-project Jun 23 22:42:37.901081 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: method: > Jun 23 22:42:37.901081 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: exception: Instance f910ba21-0126-4f09-8fd9-10f2365e67c1 could not be found. Jun 23 22:42:37.901081 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: action_args: {'id': 'f910ba21-0126-4f09-8fd9-10f2365e67c1'} Jun 23 22:42:37.902652 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:42:37.902652 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:42:37.902652 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:42:37.902652 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:42:37.902652 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:42:37.902652 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:42:37.902652 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:42:37.902652 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:42:37.902652 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:42:37.902652 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:42:37.902652 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f910ba21-0126-4f09-8fd9-10f2365e67c1 could not be found. Jun 23 22:42:37.902652 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:42:37.902652 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:42:37.902652 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:42:37.902652 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:42:37.902652 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:42:37.902652 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:42:37.902652 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:42:37.902652 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:42:37.902652 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:42:37.904132 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:42:37.904132 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:42:37.904132 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:42:37.904132 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:42:37.904132 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:42:37.904132 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:42:37.904132 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:42:37.904132 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f910ba21-0126-4f09-8fd9-10f2365e67c1 could not be found. Jun 23 22:42:37.904132 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:42:37.904132 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:42:37.904132 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:42:37.904132 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:42:37.904132 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:42:37.904132 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:42:37.904132 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:42:37.904132 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:42:37.904132 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f910ba21-0126-4f09-8fd9-10f2365e67c1 could not be found. Jun 23 22:42:37.904132 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:42:37.905684 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-030497b4-d0c7-4af5-9709-b029928f6523 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] Returning 404 to user: Instance f910ba21-0126-4f09-8fd9-10f2365e67c1 could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:42:37.905684 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-030497b4-d0c7-4af5-9709-b029928f6523 tempest-AttachVolumeTestJSON-545622694 tempest-AttachVolumeTestJSON-545622694-project] 10.222.0.43 "GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1" status: 404 len: 111 microversion: 2.1 time: 0.028357 Jun 23 22:42:37.905684 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 333/686] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:37 2022] GET /compute/v2.1/servers/f910ba21-0126-4f09-8fd9-10f2365e67c1 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:42:37.965609 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-4dde21a7-1428-4569-a192-2b8ddc739397 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:37.973613 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-4dde21a7-1428-4569-a192-2b8ddc739397 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1567 microversion: 2.1 time: 0.180038 Jun 23 22:42:37.974173 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 354/687] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:37 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:38.992611 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-2a7a366e-1b29-43d8-9dd4-86f9aedbb82f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:38.993219 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-2a7a366e-1b29-43d8-9dd4-86f9aedbb82f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:39.001606 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2a7a366e-1b29-43d8-9dd4-86f9aedbb82f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:39.002042 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2a7a366e-1b29-43d8-9dd4-86f9aedbb82f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:39.002820 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2a7a366e-1b29-43d8-9dd4-86f9aedbb82f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:39.003275 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2a7a366e-1b29-43d8-9dd4-86f9aedbb82f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:39.259911 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-2a7a366e-1b29-43d8-9dd4-86f9aedbb82f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:39.268116 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-2a7a366e-1b29-43d8-9dd4-86f9aedbb82f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1567 microversion: 2.1 time: 0.279266 Jun 23 22:42:39.268777 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 334/688] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:38 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1567 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:40.285606 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-cb8bd0d8-a839-426b-b34c-553ce9ef6b02 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:40.286294 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-cb8bd0d8-a839-426b-b34c-553ce9ef6b02 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:40.294579 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-cb8bd0d8-a839-426b-b34c-553ce9ef6b02 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:40.295520 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-cb8bd0d8-a839-426b-b34c-553ce9ef6b02 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:40.296300 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-cb8bd0d8-a839-426b-b34c-553ce9ef6b02 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:40.296738 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-cb8bd0d8-a839-426b-b34c-553ce9ef6b02 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:40.431422 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-cb8bd0d8-a839-426b-b34c-553ce9ef6b02 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:40.440476 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-cb8bd0d8-a839-426b-b34c-553ce9ef6b02 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1567 microversion: 2.1 time: 0.158976 Jun 23 22:42:40.441043 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 355/689] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:40 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:42:41.458366 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d0f06681-688c-4aaa-9b10-4abdbf7496c7 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:41.459051 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-d0f06681-688c-4aaa-9b10-4abdbf7496c7 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:41.467121 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d0f06681-688c-4aaa-9b10-4abdbf7496c7 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:41.467640 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d0f06681-688c-4aaa-9b10-4abdbf7496c7 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:41.468400 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d0f06681-688c-4aaa-9b10-4abdbf7496c7 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:41.469176 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d0f06681-688c-4aaa-9b10-4abdbf7496c7 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:41.622494 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d0f06681-688c-4aaa-9b10-4abdbf7496c7 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:41.630384 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d0f06681-688c-4aaa-9b10-4abdbf7496c7 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1567 microversion: 2.1 time: 0.176464 Jun 23 22:42:41.630976 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 335/690] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:41 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:42.382183 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-b58d5a22-7a8b-4610-b4f0-1a739f74210a tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] Action: 'create', calling method: .version_select at 0x7fb7197b2550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-451827165"}} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:42:42.650554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d36a070d-29e1-4e5c-b29c-0c16b7fd6108 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:42.652090 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-d36a070d-29e1-4e5c-b29c-0c16b7fd6108 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:42.659476 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d36a070d-29e1-4e5c-b29c-0c16b7fd6108 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:42.659993 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d36a070d-29e1-4e5c-b29c-0c16b7fd6108 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:42.660901 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d36a070d-29e1-4e5c-b29c-0c16b7fd6108 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:42.661531 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d36a070d-29e1-4e5c-b29c-0c16b7fd6108 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:42.686255 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-b58d5a22-7a8b-4610-b4f0-1a739f74210a tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.423810 Jun 23 22:42:42.687111 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 356/691] 10.222.0.43 () {60 vars in 1154 bytes} [Thu Jun 23 22:42:42 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 426 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 23 22:42:42.697502 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-9ef4b41c-ffcc-4341-a0f6-81753fbe203e tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] Calling method '.version_select at 0x7fb7196859d0>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:42.757668 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-9ef4b41c-ffcc-4341-a0f6-81753fbe203e tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/aa0786c8-de57-4215-8ffe-764a7d4dea2d" status: 200 len: 344 microversion: 2.1 time: 0.063675 Jun 23 22:42:42.758538 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 357/692] 10.222.0.43 () {58 vars in 1244 bytes} [Thu Jun 23 22:42:42 2022] GET /compute/v2.1/os-volumes/aa0786c8-de57-4215-8ffe-764a7d4dea2d => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:42:42.807917 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d36a070d-29e1-4e5c-b29c-0c16b7fd6108 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:42.815863 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d36a070d-29e1-4e5c-b29c-0c16b7fd6108 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1568 microversion: 2.1 time: 0.169319 Jun 23 22:42:42.816460 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 336/693] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:42 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:42.833137 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-a81c692f-3033-42cb-87d5-51ae4d1b748b tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:42:42.833707 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-a81c692f-3033-42cb-87d5-51ae4d1b748b tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:42.841193 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a81c692f-3033-42cb-87d5-51ae4d1b748b tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:42.841638 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a81c692f-3033-42cb-87d5-51ae4d1b748b tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:42.842400 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a81c692f-3033-42cb-87d5-51ae4d1b748b tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:42.842832 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a81c692f-3033-42cb-87d5-51ae4d1b748b tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:42.929982 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-a81c692f-3033-42cb-87d5-51ae4d1b748b tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "POST /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac/action" status: 202 len: 0 microversion: 2.1 time: 0.100824 Jun 23 22:42:42.930583 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 358/694] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Jun 23 22:42:42 2022] POST /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:42:42.938702 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a61b377a-7624-497b-bc79-0741ecd8a1d3 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:42.939467 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-a61b377a-7624-497b-bc79-0741ecd8a1d3 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:42.945641 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a61b377a-7624-497b-bc79-0741ecd8a1d3 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:42.946094 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a61b377a-7624-497b-bc79-0741ecd8a1d3 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:42.946852 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a61b377a-7624-497b-bc79-0741ecd8a1d3 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:42.947310 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a61b377a-7624-497b-bc79-0741ecd8a1d3 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:43.087506 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-a61b377a-7624-497b-bc79-0741ecd8a1d3 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:43.095767 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-a61b377a-7624-497b-bc79-0741ecd8a1d3 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1516 microversion: 2.1 time: 0.160855 Jun 23 22:42:43.096468 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 337/695] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:42 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:43.770576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-fad4b90e-bf29-4f72-b38e-ae2ba7a7e2ea tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] Calling method '.version_select at 0x7fb71968a040>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:43.816920 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-fad4b90e-bf29-4f72-b38e-ae2ba7a7e2ea tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/aa0786c8-de57-4215-8ffe-764a7d4dea2d" status: 200 len: 345 microversion: 2.1 time: 0.050895 Jun 23 22:42:43.817489 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 359/696] 10.222.0.43 () {58 vars in 1244 bytes} [Thu Jun 23 22:42:43 2022] GET /compute/v2.1/os-volumes/aa0786c8-de57-4215-8ffe-764a7d4dea2d => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:42:43.828394 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-5bb7c462-1f00-4e2a-b8bc-965be080a828 tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] Action: 'create', calling method: .version_select at 0x7fb719692700>, body: {"snapshot": {"volume_id": "aa0786c8-de57-4215-8ffe-764a7d4dea2d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-292073676"}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:42:43.984651 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-5bb7c462-1f00-4e2a-b8bc-965be080a828 tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] 10.222.0.43 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.160068 Jun 23 22:42:43.990862 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 338/697] 10.222.0.43 () {60 vars in 1161 bytes} [Thu Jun 23 22:42:43 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:42:43.996090 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-44c6bd53-c708-4fd5-b7da-422f3bc4fd53 tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] Calling method '.version_select at 0x7fb71966d820>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:44.028873 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-44c6bd53-c708-4fd5-b7da-422f3bc4fd53 tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/17cffdd9-9f62-42b9-9307-f8c38e5c4d1e" status: 200 len: 286 microversion: 2.1 time: 0.036778 Jun 23 22:42:44.029452 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 360/698] 10.222.0.43 () {58 vars in 1250 bytes} [Thu Jun 23 22:42:43 2022] GET /compute/v2.1/os-snapshots/17cffdd9-9f62-42b9-9307-f8c38e5c4d1e => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:42:44.039134 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-1b810cb2-e8f0-481e-bf6e-a93c11f36c83 tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] Calling method '.version_select at 0x7fb719702c10>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:44.068983 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-1b810cb2-e8f0-481e-bf6e-a93c11f36c83 tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.033630 Jun 23 22:42:44.069543 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 339/699] 10.222.0.43 () {58 vars in 1139 bytes} [Thu Jun 23 22:42:44 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:42:44.079974 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-8bfa44c8-464e-49f6-9f0e-243c14e2ca7b tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] Calling method '.version_select at 0x7fb7197ecd30>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:44.110781 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-8bfa44c8-464e-49f6-9f0e-243c14e2ca7b tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/17cffdd9-9f62-42b9-9307-f8c38e5c4d1e" status: 200 len: 286 microversion: 2.1 time: 0.034532 Jun 23 22:42:44.111390 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 361/700] 10.222.0.43 () {58 vars in 1250 bytes} [Thu Jun 23 22:42:44 2022] GET /compute/v2.1/os-snapshots/17cffdd9-9f62-42b9-9307-f8c38e5c4d1e => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:42:44.113317 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-44a7aac4-3bd8-43a8-a8d1-36dbf9e324f9 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:44.113932 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-44a7aac4-3bd8-43a8-a8d1-36dbf9e324f9 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:44.121057 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-44a7aac4-3bd8-43a8-a8d1-36dbf9e324f9 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:44.121505 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-44a7aac4-3bd8-43a8-a8d1-36dbf9e324f9 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:44.122311 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-44a7aac4-3bd8-43a8-a8d1-36dbf9e324f9 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:44.122742 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-44a7aac4-3bd8-43a8-a8d1-36dbf9e324f9 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:44.250586 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-44a7aac4-3bd8-43a8-a8d1-36dbf9e324f9 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:44.258123 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-44a7aac4-3bd8-43a8-a8d1-36dbf9e324f9 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1518 microversion: 2.1 time: 0.148927 Jun 23 22:42:44.258683 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 340/701] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:44 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1518 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:42:45.123071 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-593e7abd-f647-4691-89d0-08c7a78caa9c tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] Calling method '.version_select at 0x7fb71966d3a0>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:45.152112 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-593e7abd-f647-4691-89d0-08c7a78caa9c tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/17cffdd9-9f62-42b9-9307-f8c38e5c4d1e" status: 200 len: 286 microversion: 2.1 time: 0.033816 Jun 23 22:42:45.152675 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 362/702] 10.222.0.43 () {58 vars in 1250 bytes} [Thu Jun 23 22:42:45 2022] GET /compute/v2.1/os-snapshots/17cffdd9-9f62-42b9-9307-f8c38e5c4d1e => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:42:45.276238 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c2def413-4507-4979-a3a0-7e1c3a3e3bd3 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:45.277053 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c2def413-4507-4979-a3a0-7e1c3a3e3bd3 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:45.286681 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c2def413-4507-4979-a3a0-7e1c3a3e3bd3 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:45.287355 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c2def413-4507-4979-a3a0-7e1c3a3e3bd3 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:45.288753 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c2def413-4507-4979-a3a0-7e1c3a3e3bd3 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:45.289534 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c2def413-4507-4979-a3a0-7e1c3a3e3bd3 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:45.419892 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c2def413-4507-4979-a3a0-7e1c3a3e3bd3 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:45.427807 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c2def413-4507-4979-a3a0-7e1c3a3e3bd3 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1518 microversion: 2.1 time: 0.155623 Jun 23 22:42:45.428375 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 341/703] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:45 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:46.164399 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-3bb3347b-abd4-4c5d-b653-2c44437b27b9 tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] Calling method '.version_select at 0x7fb719774160>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:46.196913 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-3bb3347b-abd4-4c5d-b653-2c44437b27b9 tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/17cffdd9-9f62-42b9-9307-f8c38e5c4d1e" status: 200 len: 286 microversion: 2.1 time: 0.036210 Jun 23 22:42:46.197567 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 363/704] 10.222.0.43 () {58 vars in 1250 bytes} [Thu Jun 23 22:42:46 2022] GET /compute/v2.1/os-snapshots/17cffdd9-9f62-42b9-9307-f8c38e5c4d1e => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:42:46.206701 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-d1838ef5-7971-44fd-9a46-4c13335bd1c7 req-7bec537e-7c68-4427-be66-8e7d36deb8e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "628515ea-c2f6-490f-a67d-13d0e97698ac", "name": "network-vif-unplugged", "status": "completed", "tag": "0b2f39d0-0fe2-4db8-9e32-5112a69d2b21"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:42:46.214720 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-d1838ef5-7971-44fd-9a46-4c13335bd1c7 req-7bec537e-7c68-4427-be66-8e7d36deb8e8 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:46.215251 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-d1838ef5-7971-44fd-9a46-4c13335bd1c7 req-7bec537e-7c68-4427-be66-8e7d36deb8e8 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:46.226411 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.compute.server_external_events [req-d1838ef5-7971-44fd-9a46-4c13335bd1c7 req-7bec537e-7c68-4427-be66-8e7d36deb8e8 service nova] Unable to find a host for instance 628515ea-c2f6-490f-a67d-13d0e97698ac. Dropping event network-vif-unplugged {{(pid=124358) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 23 22:42:46.227303 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-d1838ef5-7971-44fd-9a46-4c13335bd1c7 req-7bec537e-7c68-4427-be66-8e7d36deb8e8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.024354 Jun 23 22:42:46.227890 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 342/705] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 25 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 23 22:42:46.445430 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-72321887-8da3-4270-abaa-40aaadd7b1b7 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:46.446049 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-72321887-8da3-4270-abaa-40aaadd7b1b7 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:46.453023 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-72321887-8da3-4270-abaa-40aaadd7b1b7 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:46.453466 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-72321887-8da3-4270-abaa-40aaadd7b1b7 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:46.454223 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-72321887-8da3-4270-abaa-40aaadd7b1b7 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:46.454655 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-72321887-8da3-4270-abaa-40aaadd7b1b7 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:46.586032 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-72321887-8da3-4270-abaa-40aaadd7b1b7 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:46.593453 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-72321887-8da3-4270-abaa-40aaadd7b1b7 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1518 microversion: 2.1 time: 0.151952 Jun 23 22:42:46.594015 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 364/706] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:46 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:47.209597 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-aed6e73b-b219-44c1-98a8-a6141b7aa7b1 tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] Calling method '.version_select at 0x7fb7196cc5e0>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:47.241731 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-aed6e73b-b219-44c1-98a8-a6141b7aa7b1 tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/17cffdd9-9f62-42b9-9307-f8c38e5c4d1e" status: 200 len: 286 microversion: 2.1 time: 0.035995 Jun 23 22:42:47.242393 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 343/707] 10.222.0.43 () {58 vars in 1250 bytes} [Thu Jun 23 22:42:47 2022] GET /compute/v2.1/os-snapshots/17cffdd9-9f62-42b9-9307-f8c38e5c4d1e => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:42:47.610424 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-83d9ae5d-8784-4ab5-9316-932ca10906ec tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:47.611067 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-83d9ae5d-8784-4ab5-9316-932ca10906ec tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:47.617476 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-83d9ae5d-8784-4ab5-9316-932ca10906ec tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:47.617920 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-83d9ae5d-8784-4ab5-9316-932ca10906ec tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:47.618674 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-83d9ae5d-8784-4ab5-9316-932ca10906ec tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:47.619146 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-83d9ae5d-8784-4ab5-9316-932ca10906ec tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:47.756541 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-83d9ae5d-8784-4ab5-9316-932ca10906ec tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:47.764320 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-83d9ae5d-8784-4ab5-9316-932ca10906ec tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1518 microversion: 2.1 time: 0.157740 Jun 23 22:42:47.764884 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 365/708] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:47 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:48.254100 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-384355a6-4125-485d-8856-76348c879559 tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] Calling method '.version_select at 0x7fb7196921f0>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:48.284670 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-384355a6-4125-485d-8856-76348c879559 tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/17cffdd9-9f62-42b9-9307-f8c38e5c4d1e" status: 200 len: 287 microversion: 2.1 time: 0.034801 Jun 23 22:42:48.285234 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 344/709] 10.222.0.43 () {58 vars in 1250 bytes} [Thu Jun 23 22:42:48 2022] GET /compute/v2.1/os-snapshots/17cffdd9-9f62-42b9-9307-f8c38e5c4d1e => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:42:48.295996 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-df85bc07-2d8c-4845-9fc4-d6a63f697414 tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] Calling method '.version_select at 0x7fb719aeb790>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:48.353850 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-df85bc07-2d8c-4845-9fc4-d6a63f697414 tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] 10.222.0.43 "DELETE /compute/v2.1/os-snapshots/17cffdd9-9f62-42b9-9307-f8c38e5c4d1e" status: 202 len: 0 microversion: 2.1 time: 0.061882 Jun 23 22:42:48.354523 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 366/710] 10.222.0.43 () {58 vars in 1253 bytes} [Thu Jun 23 22:42:48 2022] DELETE /compute/v2.1/os-snapshots/17cffdd9-9f62-42b9-9307-f8c38e5c4d1e => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:42:48.362877 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-1d54d42f-0ebe-4f98-8025-517aa5582e38 tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] Calling method '.version_select at 0x7fb71967c940>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:48.397302 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-1d54d42f-0ebe-4f98-8025-517aa5582e38 tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/17cffdd9-9f62-42b9-9307-f8c38e5c4d1e" status: 200 len: 286 microversion: 2.1 time: 0.038301 Jun 23 22:42:48.397883 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 345/711] 10.222.0.43 () {58 vars in 1250 bytes} [Thu Jun 23 22:42:48 2022] GET /compute/v2.1/os-snapshots/17cffdd9-9f62-42b9-9307-f8c38e5c4d1e => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:42:48.782324 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-1bca7d26-60df-4d4c-83b2-a2462ac31838 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:48.782956 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-1bca7d26-60df-4d4c-83b2-a2462ac31838 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:48.788916 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1bca7d26-60df-4d4c-83b2-a2462ac31838 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:48.789352 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1bca7d26-60df-4d4c-83b2-a2462ac31838 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:48.790095 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1bca7d26-60df-4d4c-83b2-a2462ac31838 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:48.790783 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1bca7d26-60df-4d4c-83b2-a2462ac31838 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:48.919235 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-1bca7d26-60df-4d4c-83b2-a2462ac31838 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:48.926689 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-1bca7d26-60df-4d4c-83b2-a2462ac31838 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1574 microversion: 2.1 time: 0.149202 Jun 23 22:42:48.927290 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 367/712] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:48 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:49.409639 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f524f07f-bf79-44b6-920d-ab14b2190c95 tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] Calling method '.version_select at 0x7fb719692790>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:49.434722 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-f524f07f-bf79-44b6-920d-ab14b2190c95 tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] HTTP exception thrown: Snapshot 17cffdd9-9f62-42b9-9307-f8c38e5c4d1e could not be found. Jun 23 22:42:49.437022 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f524f07f-bf79-44b6-920d-ab14b2190c95 tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] Request method failure captured: Jun 23 22:42:49.437022 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: request: GET /compute/v2.1/os-snapshots/17cffdd9-9f62-42b9-9307-f8c38e5c4d1e HTTP/1.1 Jun 23 22:42:49.437022 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept: application/json Jun 23 22:42:49.437022 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Jun 23 22:42:49.437022 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Connection: close Jun 23 22:42:49.437022 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Length: 0 Jun 23 22:42:49.437022 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Type: application/json Jun 23 22:42:49.437022 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Host: 10.222.0.43 Jun 23 22:42:49.437022 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Jun 23 22:42:49.437022 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.9 Jun 23 22:42:49.437022 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABitOxiqIvBF8l7WySYWlBRKHva9c_uvMKKcye4hklt0uprjGPtPHSJySjSNOQDsyzFImlsO_CiDkLzATW9jNhDxacneFk6eSjxQsaid168XLxpGWVPas8zQHjsqPZFu-UmF251G2oYD315H4Wg7WUqI3W74TBqib424lT9Q1wE36YsLWo Jun 23 22:42:49.437022 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Jun 23 22:42:49.437022 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Jun 23 22:42:49.437022 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Jun 23 22:42:49.437022 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Jun 23 22:42:49.437022 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Jun 23 22:42:49.437022 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Jun 23 22:42:49.437022 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Id: ac82860a551b4ef8ad85d5a4600bca30 Jun 23 22:42:49.437022 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-647595270 Jun 23 22:42:49.437022 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Role: reader,member Jun 23 22:42:49.437022 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Roles: reader,member Jun 23 22:42:49.438655 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ac82860a551b4ef8ad85d5a4600bca30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ac82860a551b4ef8ad85d5a4600bca30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ac82860a551b4ef8ad85d5a4600bca30", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ac82860a551b4ef8ad85d5a4600bca30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:42:49.438655 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-VolumesSnapshotsTestJSON-647595270 Jun 23 22:42:49.438655 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Id: ac82860a551b4ef8ad85d5a4600bca30 Jun 23 22:42:49.438655 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-647595270 Jun 23 22:42:49.438655 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User: tempest-VolumesSnapshotsTestJSON-647595270-project Jun 23 22:42:49.438655 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Jun 23 22:42:49.438655 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Jun 23 22:42:49.438655 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Id: 5541c49aa5414afaba6997f8386a5612 Jun 23 22:42:49.438655 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-VolumesSnapshotsTestJSON-647595270-project Jun 23 22:42:49.438655 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: method: Jun 23 22:42:49.438655 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: exception: Snapshot 17cffdd9-9f62-42b9-9307-f8c38e5c4d1e could not be found. Jun 23 22:42:49.438655 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: action_args: {'id': '17cffdd9-9f62-42b9-9307-f8c38e5c4d1e'} Jun 23 22:42:49.438655 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:42:49.439750 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:42:49.439750 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 23 22:42:49.439750 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 23 22:42:49.439750 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 23 22:42:49.439750 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 23 22:42:49.439750 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 23 22:42:49.439750 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 23 22:42:49.439750 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 22:42:49.439750 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 22:42:49.439750 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 22:42:49.439750 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 22:42:49.439750 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 22:42:49.439750 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 22:42:49.439750 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 22:42:49.439750 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 22:42:49.439750 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 17cffdd9-9f62-42b9-9307-f8c38e5c4d1e could not be found. (HTTP 404) (Request-ID: req-c379ebc2-358f-4395-b727-304982fdcff7) Jun 23 22:42:49.439750 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:42:49.439750 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:42:49.441147 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:42:49.441147 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:42:49.441147 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 23 22:42:49.441147 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 23 22:42:49.441147 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 22:42:49.441147 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 22:42:49.441147 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 23 22:42:49.441147 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 23 22:42:49.441147 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 22:42:49.441147 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 22:42:49.441147 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 23 22:42:49.441147 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 23 22:42:49.441147 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 23 22:42:49.441147 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 23 22:42:49.441147 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 23 22:42:49.441147 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 23 22:42:49.441147 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 22:42:49.441147 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 22:42:49.441147 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 22:42:49.442598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 22:42:49.442598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 22:42:49.442598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 22:42:49.442598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 22:42:49.442598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 22:42:49.442598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 17cffdd9-9f62-42b9-9307-f8c38e5c4d1e could not be found. Jun 23 22:42:49.442598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:42:49.442598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:42:49.442598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:42:49.442598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:42:49.442598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:42:49.442598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:42:49.442598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:42:49.442598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:42:49.442598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 22:42:49.442598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 22:42:49.442598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:42:49.442598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:42:49.442598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 23 22:42:49.442598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:42:49.444372 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 17cffdd9-9f62-42b9-9307-f8c38e5c4d1e could not be found. Jun 23 22:42:49.444372 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:42:49.444372 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:42:49.444372 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:42:49.444372 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:42:49.444372 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:42:49.444372 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:42:49.444372 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:42:49.444372 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:42:49.444372 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 17cffdd9-9f62-42b9-9307-f8c38e5c4d1e could not be found. Jun 23 22:42:49.444372 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:42:49.444372 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f524f07f-bf79-44b6-920d-ab14b2190c95 tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] Returning 404 to user: Snapshot 17cffdd9-9f62-42b9-9307-f8c38e5c4d1e could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:42:49.444372 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f524f07f-bf79-44b6-920d-ab14b2190c95 tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/17cffdd9-9f62-42b9-9307-f8c38e5c4d1e" status: 404 len: 111 microversion: 2.1 time: 0.033254 Jun 23 22:42:49.444372 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 346/713] 10.222.0.43 () {58 vars in 1250 bytes} [Thu Jun 23 22:42:49 2022] GET /compute/v2.1/os-snapshots/17cffdd9-9f62-42b9-9307-f8c38e5c4d1e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:42:49.447581 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-7fff0303-05b7-412c-9ff3-f62ebd194127 tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] Calling method '.version_select at 0x7fb719685b80>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:49.509274 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-7fff0303-05b7-412c-9ff3-f62ebd194127 tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/aa0786c8-de57-4215-8ffe-764a7d4dea2d" status: 202 len: 0 microversion: 2.1 time: 0.065889 Jun 23 22:42:49.509847 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 368/714] 10.222.0.43 () {58 vars in 1247 bytes} [Thu Jun 23 22:42:49 2022] DELETE /compute/v2.1/os-volumes/aa0786c8-de57-4215-8ffe-764a7d4dea2d => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:42:49.519644 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-ffb303f2-35ff-4e51-8435-333ad2bb5c42 tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] Calling method '.version_select at 0x7fb7196cc0d0>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:49.571185 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-ffb303f2-35ff-4e51-8435-333ad2bb5c42 tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/aa0786c8-de57-4215-8ffe-764a7d4dea2d" status: 200 len: 344 microversion: 2.1 time: 0.055299 Jun 23 22:42:49.571754 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 347/715] 10.222.0.43 () {58 vars in 1244 bytes} [Thu Jun 23 22:42:49 2022] GET /compute/v2.1/os-volumes/aa0786c8-de57-4215-8ffe-764a7d4dea2d => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:42:49.796820 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-5c7d33fa-a7ab-482d-bff4-0bd70fb04b54 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:49.797604 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-5c7d33fa-a7ab-482d-bff4-0bd70fb04b54 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:49.804289 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5c7d33fa-a7ab-482d-bff4-0bd70fb04b54 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:49.804727 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5c7d33fa-a7ab-482d-bff4-0bd70fb04b54 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:49.805583 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5c7d33fa-a7ab-482d-bff4-0bd70fb04b54 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:49.805985 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5c7d33fa-a7ab-482d-bff4-0bd70fb04b54 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:49.832805 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-5c7d33fa-a7ab-482d-bff4-0bd70fb04b54 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4/ips" status: 200 len: 150 microversion: 2.1 time: 0.041131 Jun 23 22:42:49.833348 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 369/716] 10.222.0.43 () {58 vars in 1247 bytes} [Thu Jun 23 22:42:49 2022] GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:42:49.944185 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-2b0e6af8-674c-45d5-960f-e6036128b482 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:49.944892 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-2b0e6af8-674c-45d5-960f-e6036128b482 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:49.951530 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2b0e6af8-674c-45d5-960f-e6036128b482 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:49.952117 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2b0e6af8-674c-45d5-960f-e6036128b482 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:49.952911 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2b0e6af8-674c-45d5-960f-e6036128b482 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:49.953336 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2b0e6af8-674c-45d5-960f-e6036128b482 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:50.094774 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-2b0e6af8-674c-45d5-960f-e6036128b482 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:50.102848 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-2b0e6af8-674c-45d5-960f-e6036128b482 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1574 microversion: 2.1 time: 0.162934 Jun 23 22:42:50.103946 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 348/717] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:49 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:50.584043 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-0e9ab112-a135-4451-9ac5-5f53f38796ab tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] Calling method '.version_select at 0x7fb7197a6550>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:50.613211 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.wsgi [None req-0e9ab112-a135-4451-9ac5-5f53f38796ab tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] HTTP exception thrown: Volume aa0786c8-de57-4215-8ffe-764a7d4dea2d could not be found. Jun 23 22:42:50.615193 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-0e9ab112-a135-4451-9ac5-5f53f38796ab tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] Request method failure captured: Jun 23 22:42:50.615193 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: request: GET /compute/v2.1/os-volumes/aa0786c8-de57-4215-8ffe-764a7d4dea2d HTTP/1.1 Jun 23 22:42:50.615193 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept: application/json Jun 23 22:42:50.615193 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept-Encoding: identity Jun 23 22:42:50.615193 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Connection: close Jun 23 22:42:50.615193 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Length: 0 Jun 23 22:42:50.615193 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Type: application/json Jun 23 22:42:50.615193 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Host: 10.222.0.43 Jun 23 22:42:50.615193 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Openstack-System-Scope: None Jun 23 22:42:50.615193 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: User-Agent: python-urllib3/1.26.9 Jun 23 22:42:50.615193 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Auth-Token: gAAAAABitOxiqIvBF8l7WySYWlBRKHva9c_uvMKKcye4hklt0uprjGPtPHSJySjSNOQDsyzFImlsO_CiDkLzATW9jNhDxacneFk6eSjxQsaid168XLxpGWVPas8zQHjsqPZFu-UmF251G2oYD315H4Wg7WUqI3W74TBqib424lT9Q1wE36YsLWo Jun 23 22:42:50.615193 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Id: None Jun 23 22:42:50.615193 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Name: None Jun 23 22:42:50.615193 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Identity-Status: Confirmed Jun 23 22:42:50.615193 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Is-Admin-Project: True Jun 23 22:42:50.615193 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Id: default Jun 23 22:42:50.615193 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Name: Default Jun 23 22:42:50.615193 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Id: ac82860a551b4ef8ad85d5a4600bca30 Jun 23 22:42:50.615193 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-647595270 Jun 23 22:42:50.615193 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Role: reader,member Jun 23 22:42:50.615193 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Roles: reader,member Jun 23 22:42:50.616743 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ac82860a551b4ef8ad85d5a4600bca30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ac82860a551b4ef8ad85d5a4600bca30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ac82860a551b4ef8ad85d5a4600bca30", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ac82860a551b4ef8ad85d5a4600bca30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:42:50.616743 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant: tempest-VolumesSnapshotsTestJSON-647595270 Jun 23 22:42:50.616743 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Id: ac82860a551b4ef8ad85d5a4600bca30 Jun 23 22:42:50.616743 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-647595270 Jun 23 22:42:50.616743 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User: tempest-VolumesSnapshotsTestJSON-647595270-project Jun 23 22:42:50.616743 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Id: default Jun 23 22:42:50.616743 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Name: Default Jun 23 22:42:50.616743 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Id: 5541c49aa5414afaba6997f8386a5612 Jun 23 22:42:50.616743 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Name: tempest-VolumesSnapshotsTestJSON-647595270-project Jun 23 22:42:50.616743 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: method: Jun 23 22:42:50.616743 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: exception: Volume aa0786c8-de57-4215-8ffe-764a7d4dea2d could not be found. Jun 23 22:42:50.616743 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: action_args: {'id': 'aa0786c8-de57-4215-8ffe-764a7d4dea2d'} Jun 23 22:42:50.616743 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:42:50.617634 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:42:50.617634 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 22:42:50.617634 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 22:42:50.617634 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 22:42:50.617634 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 22:42:50.617634 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 22:42:50.617634 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 22:42:50.617634 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 22:42:50.617634 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 22:42:50.617634 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 22:42:50.617634 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 22:42:50.617634 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 22:42:50.617634 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 22:42:50.617634 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 22:42:50.617634 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 22:42:50.617634 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume aa0786c8-de57-4215-8ffe-764a7d4dea2d could not be found. (HTTP 404) (Request-ID: req-b887bd6a-1790-4e41-a4e6-32482be8724f) Jun 23 22:42:50.617634 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:42:50.617634 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:42:50.617634 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:42:50.618770 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:42:50.618770 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 22:42:50.618770 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 22:42:50.618770 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 22:42:50.618770 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 22:42:50.618770 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 22:42:50.618770 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 22:42:50.618770 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 22:42:50.618770 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 22:42:50.618770 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 22:42:50.618770 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 22:42:50.618770 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 22:42:50.618770 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 22:42:50.618770 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 22:42:50.618770 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 22:42:50.618770 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 22:42:50.618770 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 22:42:50.618770 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 22:42:50.618770 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 22:42:50.619950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 22:42:50.619950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 22:42:50.619950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 22:42:50.619950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 22:42:50.619950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume aa0786c8-de57-4215-8ffe-764a7d4dea2d could not be found. Jun 23 22:42:50.619950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:42:50.619950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:42:50.619950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:42:50.619950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:42:50.619950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:42:50.619950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:42:50.619950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:42:50.619950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:42:50.619950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 22:42:50.619950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 22:42:50.619950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:42:50.619950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:42:50.619950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 22:42:50.619950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:42:50.624132 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume aa0786c8-de57-4215-8ffe-764a7d4dea2d could not be found. Jun 23 22:42:50.624132 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:42:50.624132 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:42:50.624132 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:42:50.624132 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:42:50.624132 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:42:50.624132 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:42:50.624132 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:42:50.624132 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:42:50.624132 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume aa0786c8-de57-4215-8ffe-764a7d4dea2d could not be found. Jun 23 22:42:50.624132 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:42:50.624132 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-0e9ab112-a135-4451-9ac5-5f53f38796ab tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] Returning 404 to user: Volume aa0786c8-de57-4215-8ffe-764a7d4dea2d could not be found. {{(pid=124357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:42:50.624132 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-0e9ab112-a135-4451-9ac5-5f53f38796ab tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/aa0786c8-de57-4215-8ffe-764a7d4dea2d" status: 404 len: 109 microversion: 2.1 time: 0.036381 Jun 23 22:42:50.624132 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 370/718] 10.222.0.43 () {58 vars in 1244 bytes} [Thu Jun 23 22:42:50 2022] GET /compute/v2.1/os-volumes/aa0786c8-de57-4215-8ffe-764a7d4dea2d => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:42:50.631545 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c63ae606-f804-42a1-82b1-5067adbc231c tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] Calling method '.version_select at 0x7fb71970ff70>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:50.664914 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-c63ae606-f804-42a1-82b1-5067adbc231c tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] HTTP exception thrown: Volume aa0786c8-de57-4215-8ffe-764a7d4dea2d could not be found. Jun 23 22:42:50.667599 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c63ae606-f804-42a1-82b1-5067adbc231c tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] Request method failure captured: Jun 23 22:42:50.667599 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: request: DELETE /compute/v2.1/os-volumes/aa0786c8-de57-4215-8ffe-764a7d4dea2d HTTP/1.1 Jun 23 22:42:50.667599 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept: application/json Jun 23 22:42:50.667599 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Jun 23 22:42:50.667599 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Connection: close Jun 23 22:42:50.667599 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Length: 0 Jun 23 22:42:50.667599 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Type: application/json Jun 23 22:42:50.667599 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Host: 10.222.0.43 Jun 23 22:42:50.667599 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Jun 23 22:42:50.667599 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.9 Jun 23 22:42:50.667599 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABitOxiqIvBF8l7WySYWlBRKHva9c_uvMKKcye4hklt0uprjGPtPHSJySjSNOQDsyzFImlsO_CiDkLzATW9jNhDxacneFk6eSjxQsaid168XLxpGWVPas8zQHjsqPZFu-UmF251G2oYD315H4Wg7WUqI3W74TBqib424lT9Q1wE36YsLWo Jun 23 22:42:50.667599 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Jun 23 22:42:50.667599 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Jun 23 22:42:50.667599 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Jun 23 22:42:50.667599 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Jun 23 22:42:50.667599 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Jun 23 22:42:50.667599 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Jun 23 22:42:50.667599 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Id: ac82860a551b4ef8ad85d5a4600bca30 Jun 23 22:42:50.667599 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-647595270 Jun 23 22:42:50.667599 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Role: reader,member Jun 23 22:42:50.667599 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Roles: reader,member Jun 23 22:42:50.670154 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ac82860a551b4ef8ad85d5a4600bca30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ac82860a551b4ef8ad85d5a4600bca30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ac82860a551b4ef8ad85d5a4600bca30", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ac82860a551b4ef8ad85d5a4600bca30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:42:50.670154 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-VolumesSnapshotsTestJSON-647595270 Jun 23 22:42:50.670154 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Id: ac82860a551b4ef8ad85d5a4600bca30 Jun 23 22:42:50.670154 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-647595270 Jun 23 22:42:50.670154 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User: tempest-VolumesSnapshotsTestJSON-647595270-project Jun 23 22:42:50.670154 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Jun 23 22:42:50.670154 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Jun 23 22:42:50.670154 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Id: 5541c49aa5414afaba6997f8386a5612 Jun 23 22:42:50.670154 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-VolumesSnapshotsTestJSON-647595270-project Jun 23 22:42:50.670154 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: method: Jun 23 22:42:50.670154 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: exception: Volume aa0786c8-de57-4215-8ffe-764a7d4dea2d could not be found. Jun 23 22:42:50.670154 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: action_args: {'id': 'aa0786c8-de57-4215-8ffe-764a7d4dea2d'} Jun 23 22:42:50.670154 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:42:50.671113 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:42:50.671113 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 22:42:50.671113 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 22:42:50.671113 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 22:42:50.671113 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 22:42:50.671113 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 22:42:50.671113 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 22:42:50.671113 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 22:42:50.671113 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 22:42:50.671113 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 22:42:50.671113 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 22:42:50.671113 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 22:42:50.671113 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 22:42:50.671113 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 22:42:50.671113 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 22:42:50.671113 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume aa0786c8-de57-4215-8ffe-764a7d4dea2d could not be found. (HTTP 404) (Request-ID: req-8229cc63-9392-4fe3-9c4a-c2fbcca8f3eb) Jun 23 22:42:50.671113 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:42:50.671113 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:42:50.671113 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:42:50.672526 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:42:50.672526 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 23 22:42:50.672526 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 23 22:42:50.672526 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 22:42:50.672526 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 22:42:50.672526 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 22:42:50.672526 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 22:42:50.672526 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 22:42:50.672526 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 22:42:50.672526 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 22:42:50.672526 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 22:42:50.672526 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 22:42:50.672526 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 22:42:50.672526 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 22:42:50.672526 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 22:42:50.672526 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 22:42:50.672526 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 22:42:50.672526 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 22:42:50.672526 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 22:42:50.673940 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 22:42:50.673940 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 22:42:50.673940 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 22:42:50.673940 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 22:42:50.673940 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume aa0786c8-de57-4215-8ffe-764a7d4dea2d could not be found. Jun 23 22:42:50.673940 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:42:50.673940 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:42:50.673940 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:42:50.673940 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:42:50.673940 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:42:50.673940 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:42:50.673940 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:42:50.673940 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:42:50.673940 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 22:42:50.673940 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 22:42:50.673940 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:42:50.673940 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:42:50.673940 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 23 22:42:50.673940 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:42:50.678062 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume aa0786c8-de57-4215-8ffe-764a7d4dea2d could not be found. Jun 23 22:42:50.678062 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:42:50.678062 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:42:50.678062 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:42:50.678062 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:42:50.678062 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:42:50.678062 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:42:50.678062 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:42:50.678062 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:42:50.678062 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume aa0786c8-de57-4215-8ffe-764a7d4dea2d could not be found. Jun 23 22:42:50.678062 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:42:50.678062 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c63ae606-f804-42a1-82b1-5067adbc231c tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] Returning 404 to user: Volume aa0786c8-de57-4215-8ffe-764a7d4dea2d could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:42:50.678062 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c63ae606-f804-42a1-82b1-5067adbc231c tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/aa0786c8-de57-4215-8ffe-764a7d4dea2d" status: 404 len: 109 microversion: 2.1 time: 0.042709 Jun 23 22:42:50.678062 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 349/719] 10.222.0.43 () {58 vars in 1247 bytes} [Thu Jun 23 22:42:50 2022] DELETE /compute/v2.1/os-volumes/aa0786c8-de57-4215-8ffe-764a7d4dea2d => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:42:50.679178 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-b356249d-62c3-47ca-8b6e-55795efacb4d tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] Calling method '.version_select at 0x7fb71961b3a0>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:50.706581 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.wsgi [None req-b356249d-62c3-47ca-8b6e-55795efacb4d tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] HTTP exception thrown: Volume aa0786c8-de57-4215-8ffe-764a7d4dea2d could not be found. Jun 23 22:42:50.708567 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-b356249d-62c3-47ca-8b6e-55795efacb4d tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] Request method failure captured: Jun 23 22:42:50.708567 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: request: GET /compute/v2.1/os-volumes/aa0786c8-de57-4215-8ffe-764a7d4dea2d HTTP/1.1 Jun 23 22:42:50.708567 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept: application/json Jun 23 22:42:50.708567 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept-Encoding: identity Jun 23 22:42:50.708567 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Connection: close Jun 23 22:42:50.708567 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Length: 0 Jun 23 22:42:50.708567 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Type: application/json Jun 23 22:42:50.708567 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Host: 10.222.0.43 Jun 23 22:42:50.708567 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Openstack-System-Scope: None Jun 23 22:42:50.708567 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: User-Agent: python-urllib3/1.26.9 Jun 23 22:42:50.708567 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Auth-Token: gAAAAABitOxiqIvBF8l7WySYWlBRKHva9c_uvMKKcye4hklt0uprjGPtPHSJySjSNOQDsyzFImlsO_CiDkLzATW9jNhDxacneFk6eSjxQsaid168XLxpGWVPas8zQHjsqPZFu-UmF251G2oYD315H4Wg7WUqI3W74TBqib424lT9Q1wE36YsLWo Jun 23 22:42:50.708567 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Id: None Jun 23 22:42:50.708567 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Name: None Jun 23 22:42:50.708567 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Identity-Status: Confirmed Jun 23 22:42:50.708567 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Is-Admin-Project: True Jun 23 22:42:50.708567 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Id: default Jun 23 22:42:50.708567 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Name: Default Jun 23 22:42:50.708567 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Id: ac82860a551b4ef8ad85d5a4600bca30 Jun 23 22:42:50.708567 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-647595270 Jun 23 22:42:50.708567 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Role: reader,member Jun 23 22:42:50.708567 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Roles: reader,member Jun 23 22:42:50.710256 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ac82860a551b4ef8ad85d5a4600bca30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ac82860a551b4ef8ad85d5a4600bca30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ac82860a551b4ef8ad85d5a4600bca30", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ac82860a551b4ef8ad85d5a4600bca30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:42:50.710256 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant: tempest-VolumesSnapshotsTestJSON-647595270 Jun 23 22:42:50.710256 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Id: ac82860a551b4ef8ad85d5a4600bca30 Jun 23 22:42:50.710256 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-647595270 Jun 23 22:42:50.710256 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User: tempest-VolumesSnapshotsTestJSON-647595270-project Jun 23 22:42:50.710256 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Id: default Jun 23 22:42:50.710256 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Name: Default Jun 23 22:42:50.710256 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Id: 5541c49aa5414afaba6997f8386a5612 Jun 23 22:42:50.710256 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Name: tempest-VolumesSnapshotsTestJSON-647595270-project Jun 23 22:42:50.710256 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: method: Jun 23 22:42:50.710256 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: exception: Volume aa0786c8-de57-4215-8ffe-764a7d4dea2d could not be found. Jun 23 22:42:50.710256 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: action_args: {'id': 'aa0786c8-de57-4215-8ffe-764a7d4dea2d'} Jun 23 22:42:50.710256 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:42:50.711224 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:42:50.711224 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 22:42:50.711224 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 22:42:50.711224 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 22:42:50.711224 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 22:42:50.711224 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 22:42:50.711224 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 22:42:50.711224 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 22:42:50.711224 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 22:42:50.711224 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 22:42:50.711224 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 22:42:50.711224 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 22:42:50.711224 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 22:42:50.711224 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 22:42:50.711224 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 22:42:50.711224 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume aa0786c8-de57-4215-8ffe-764a7d4dea2d could not be found. (HTTP 404) (Request-ID: req-ec79ff6f-6d0d-4abd-8083-5759b0902d31) Jun 23 22:42:50.711224 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:42:50.711224 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:42:50.711224 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:42:50.712610 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:42:50.712610 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 22:42:50.712610 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 22:42:50.712610 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 22:42:50.712610 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 22:42:50.712610 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 22:42:50.712610 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 22:42:50.712610 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 22:42:50.712610 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 22:42:50.712610 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 22:42:50.712610 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 22:42:50.712610 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 22:42:50.712610 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 22:42:50.712610 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 22:42:50.712610 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 22:42:50.712610 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 22:42:50.712610 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 22:42:50.712610 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 22:42:50.712610 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 22:42:50.713978 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 22:42:50.713978 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 22:42:50.713978 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 22:42:50.713978 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 22:42:50.713978 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume aa0786c8-de57-4215-8ffe-764a7d4dea2d could not be found. Jun 23 22:42:50.713978 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:42:50.713978 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:42:50.713978 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:42:50.713978 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:42:50.713978 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:42:50.713978 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:42:50.713978 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:42:50.713978 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:42:50.713978 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 22:42:50.713978 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 22:42:50.713978 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:42:50.713978 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:42:50.713978 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 22:42:50.713978 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:42:50.716011 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume aa0786c8-de57-4215-8ffe-764a7d4dea2d could not be found. Jun 23 22:42:50.716011 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:42:50.716011 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:42:50.716011 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:42:50.716011 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:42:50.716011 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:42:50.716011 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:42:50.716011 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:42:50.716011 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:42:50.716011 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume aa0786c8-de57-4215-8ffe-764a7d4dea2d could not be found. Jun 23 22:42:50.716011 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:42:50.716011 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-b356249d-62c3-47ca-8b6e-55795efacb4d tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] Returning 404 to user: Volume aa0786c8-de57-4215-8ffe-764a7d4dea2d could not be found. {{(pid=124357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:42:50.716011 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-b356249d-62c3-47ca-8b6e-55795efacb4d tempest-VolumesSnapshotsTestJSON-647595270 tempest-VolumesSnapshotsTestJSON-647595270-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/aa0786c8-de57-4215-8ffe-764a7d4dea2d" status: 404 len: 109 microversion: 2.1 time: 0.034908 Jun 23 22:42:50.716011 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 371/720] 10.222.0.43 () {58 vars in 1244 bytes} [Thu Jun 23 22:42:50 2022] GET /compute/v2.1/os-volumes/aa0786c8-de57-4215-8ffe-764a7d4dea2d => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:42:51.123239 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-79673412-18de-4a1a-ad41-b0e2ae27b4c5 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:51.123934 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-79673412-18de-4a1a-ad41-b0e2ae27b4c5 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:51.131986 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-79673412-18de-4a1a-ad41-b0e2ae27b4c5 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:51.131986 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-79673412-18de-4a1a-ad41-b0e2ae27b4c5 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:51.132470 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-79673412-18de-4a1a-ad41-b0e2ae27b4c5 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:51.132955 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-79673412-18de-4a1a-ad41-b0e2ae27b4c5 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:51.188148 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-00ada3ae-ffef-44c3-98e6-ef434cb9cbb1 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b860202-457a-425d-a9e9-ccd27d7cd6b1"}} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:42:51.189581 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-00ada3ae-ffef-44c3-98e6-ef434cb9cbb1 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:51.196826 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-00ada3ae-ffef-44c3-98e6-ef434cb9cbb1 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:51.197444 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-00ada3ae-ffef-44c3-98e6-ef434cb9cbb1 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:51.198577 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-00ada3ae-ffef-44c3-98e6-ef434cb9cbb1 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:51.200075 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-00ada3ae-ffef-44c3-98e6-ef434cb9cbb1 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:51.280507 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-79673412-18de-4a1a-ad41-b0e2ae27b4c5 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:51.290025 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-79673412-18de-4a1a-ad41-b0e2ae27b4c5 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1574 microversion: 2.1 time: 0.171744 Jun 23 22:42:51.291187 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 350/721] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:51 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1574 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:51.519124 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-00ada3ae-ffef-44c3-98e6-ef434cb9cbb1 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "POST /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335732 Jun 23 22:42:51.522962 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 372/722] 10.222.0.43 () {60 vars in 1322 bytes} [Thu Jun 23 22:42:51 2022] POST /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:42:52.308413 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c67f7371-d557-4c5f-a039-b73bdcefcfdd tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:52.310076 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c67f7371-d557-4c5f-a039-b73bdcefcfdd tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:52.315950 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c67f7371-d557-4c5f-a039-b73bdcefcfdd tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:52.316430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c67f7371-d557-4c5f-a039-b73bdcefcfdd tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:52.317194 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c67f7371-d557-4c5f-a039-b73bdcefcfdd tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:52.317611 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c67f7371-d557-4c5f-a039-b73bdcefcfdd tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:52.463460 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c67f7371-d557-4c5f-a039-b73bdcefcfdd tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:52.471949 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c67f7371-d557-4c5f-a039-b73bdcefcfdd tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1574 microversion: 2.1 time: 0.167428 Jun 23 22:42:52.472755 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 351/723] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:52 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:53.491600 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-841eb938-f79d-4895-9378-862d42a1a172 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:53.492465 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-841eb938-f79d-4895-9378-862d42a1a172 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:53.500230 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-841eb938-f79d-4895-9378-862d42a1a172 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:53.500674 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-841eb938-f79d-4895-9378-862d42a1a172 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:53.501433 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-841eb938-f79d-4895-9378-862d42a1a172 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:53.501861 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-841eb938-f79d-4895-9378-862d42a1a172 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:53.650979 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-841eb938-f79d-4895-9378-862d42a1a172 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:53.661548 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-841eb938-f79d-4895-9378-862d42a1a172 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1574 microversion: 2.1 time: 0.175490 Jun 23 22:42:53.662370 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 373/724] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:53 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1574 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:42:54.681017 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-75c8d8b5-e8d4-4e19-a137-a8eaf6fd1f2d tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:54.681715 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-75c8d8b5-e8d4-4e19-a137-a8eaf6fd1f2d tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:54.688922 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-75c8d8b5-e8d4-4e19-a137-a8eaf6fd1f2d tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:54.689363 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-75c8d8b5-e8d4-4e19-a137-a8eaf6fd1f2d tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:54.690126 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-75c8d8b5-e8d4-4e19-a137-a8eaf6fd1f2d tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:54.690548 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-75c8d8b5-e8d4-4e19-a137-a8eaf6fd1f2d tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:54.693412 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:42:54.895742 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-75c8d8b5-e8d4-4e19-a137-a8eaf6fd1f2d tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:54.904028 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-75c8d8b5-e8d4-4e19-a137-a8eaf6fd1f2d tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1574 microversion: 2.1 time: 0.226790 Jun 23 22:42:54.904606 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 352/725] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:54 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1574 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:55.922288 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-70118e08-a4f9-4bb4-ba78-c367f5b4ed9c tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:55.922900 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-70118e08-a4f9-4bb4-ba78-c367f5b4ed9c tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:55.930157 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-70118e08-a4f9-4bb4-ba78-c367f5b4ed9c tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:55.930613 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-70118e08-a4f9-4bb4-ba78-c367f5b4ed9c tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:55.931500 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-70118e08-a4f9-4bb4-ba78-c367f5b4ed9c tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:55.931936 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-70118e08-a4f9-4bb4-ba78-c367f5b4ed9c tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:56.090570 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-70118e08-a4f9-4bb4-ba78-c367f5b4ed9c tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:56.099774 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-70118e08-a4f9-4bb4-ba78-c367f5b4ed9c tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1574 microversion: 2.1 time: 0.182347 Jun 23 22:42:56.100342 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 374/726] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:55 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1574 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:57.117343 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-1f08535b-b5fd-46ff-b815-6cab55b9adb4 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:57.118298 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-1f08535b-b5fd-46ff-b815-6cab55b9adb4 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:57.121934 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:42:57.126562 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1f08535b-b5fd-46ff-b815-6cab55b9adb4 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:57.127253 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1f08535b-b5fd-46ff-b815-6cab55b9adb4 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:57.128295 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1f08535b-b5fd-46ff-b815-6cab55b9adb4 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:57.129020 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1f08535b-b5fd-46ff-b815-6cab55b9adb4 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:57.274211 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-1f08535b-b5fd-46ff-b815-6cab55b9adb4 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:57.281856 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-1f08535b-b5fd-46ff-b815-6cab55b9adb4 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1574 microversion: 2.1 time: 0.168952 Jun 23 22:42:57.282414 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 353/727] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:57 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1574 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:58.101919 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [req-0fe7a16d-e8c8-4b0e-9732-25a5a54aac5d req-08de004c-9ea2-41e1-b96e-e4b7c907dd13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "628515ea-c2f6-490f-a67d-13d0e97698ac", "name": "network-vif-plugged", "status": "completed", "tag": "0b2f39d0-0fe2-4db8-9e32-5112a69d2b21"}]} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:42:58.118652 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-0fe7a16d-e8c8-4b0e-9732-25a5a54aac5d req-08de004c-9ea2-41e1-b96e-e4b7c907dd13 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:58.119266 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-0fe7a16d-e8c8-4b0e-9732-25a5a54aac5d req-08de004c-9ea2-41e1-b96e-e4b7c907dd13 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:58.133215 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.compute.server_external_events [req-0fe7a16d-e8c8-4b0e-9732-25a5a54aac5d req-08de004c-9ea2-41e1-b96e-e4b7c907dd13 service nova] Creating event network-vif-plugged:0b2f39d0-0fe2-4db8-9e32-5112a69d2b21 for instance 628515ea-c2f6-490f-a67d-13d0e97698ac on hv-cinder-84617 Jun 23 22:42:58.141521 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [req-0fe7a16d-e8c8-4b0e-9732-25a5a54aac5d req-08de004c-9ea2-41e1-b96e-e4b7c907dd13 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047271 Jun 23 22:42:58.147684 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 375/728] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:42:58.301121 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-33524ac4-55fe-42a8-9586-cad2edc2ef1a tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:58.301756 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-33524ac4-55fe-42a8-9586-cad2edc2ef1a tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:58.309076 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-33524ac4-55fe-42a8-9586-cad2edc2ef1a tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:58.309845 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-33524ac4-55fe-42a8-9586-cad2edc2ef1a tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:58.310614 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-33524ac4-55fe-42a8-9586-cad2edc2ef1a tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:58.311061 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-33524ac4-55fe-42a8-9586-cad2edc2ef1a tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:58.539657 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-33524ac4-55fe-42a8-9586-cad2edc2ef1a tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:58.551184 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-33524ac4-55fe-42a8-9586-cad2edc2ef1a tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1574 microversion: 2.1 time: 0.254161 Jun 23 22:42:58.552025 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 354/729] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:58 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1574 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:42:59.229074 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-7caf6e2b-e69b-417b-8743-6ff70ea9a350 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:59.229668 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-7caf6e2b-e69b-417b-8743-6ff70ea9a350 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:59.232416 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:42:59.239105 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7caf6e2b-e69b-417b-8743-6ff70ea9a350 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:59.239554 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7caf6e2b-e69b-417b-8743-6ff70ea9a350 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:59.240342 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7caf6e2b-e69b-417b-8743-6ff70ea9a350 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:59.240940 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7caf6e2b-e69b-417b-8743-6ff70ea9a350 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:59.349000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.objects.instance [None req-7caf6e2b-e69b-417b-8743-6ff70ea9a350 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lazy-loading 'services' on Instance uuid ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 {{(pid=124357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:42:59.486672 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-7caf6e2b-e69b-417b-8743-6ff70ea9a350 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4/os-volume_attachments/4b860202-457a-425d-a9e9-ccd27d7cd6b1" status: 202 len: 0 microversion: 2.1 time: 0.262300 Jun 23 22:42:59.487626 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 376/730] 10.222.0.43 () {58 vars in 1415 bytes} [Thu Jun 23 22:42:59 2022] DELETE /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4/os-volume_attachments/4b860202-457a-425d-a9e9-ccd27d7cd6b1 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:42:59.496796 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a3da1764-6e9a-4ce3-9157-28ac5c36949b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:59.498684 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-a3da1764-6e9a-4ce3-9157-28ac5c36949b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:59.516082 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a3da1764-6e9a-4ce3-9157-28ac5c36949b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:59.516525 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a3da1764-6e9a-4ce3-9157-28ac5c36949b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:59.517333 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a3da1764-6e9a-4ce3-9157-28ac5c36949b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:59.517754 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a3da1764-6e9a-4ce3-9157-28ac5c36949b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:59.565501 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-a3da1764-6e9a-4ce3-9157-28ac5c36949b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073268 Jun 23 22:42:59.566264 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 355/731] 10.222.0.43 () {58 vars in 1301 bytes} [Thu Jun 23 22:42:59 2022] GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:42:59.574302 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-c01e0b15-46e3-4e28-abab-9e63370056bf tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:42:59.575522 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-c01e0b15-46e3-4e28-abab-9e63370056bf tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:42:59.584690 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c01e0b15-46e3-4e28-abab-9e63370056bf tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:59.585249 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c01e0b15-46e3-4e28-abab-9e63370056bf tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:59.586035 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c01e0b15-46e3-4e28-abab-9e63370056bf tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:42:59.586460 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c01e0b15-46e3-4e28-abab-9e63370056bf tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:42:59.757910 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-c01e0b15-46e3-4e28-abab-9e63370056bf tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:42:59.766316 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-c01e0b15-46e3-4e28-abab-9e63370056bf tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1574 microversion: 2.1 time: 0.200346 Jun 23 22:42:59.766894 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 377/732] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:42:59 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1574 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:43:00.577815 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e1196ea9-8b14-4aca-a572-ed955847213b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:00.578740 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e1196ea9-8b14-4aca-a572-ed955847213b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:00.585328 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e1196ea9-8b14-4aca-a572-ed955847213b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:00.585775 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e1196ea9-8b14-4aca-a572-ed955847213b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:00.586545 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e1196ea9-8b14-4aca-a572-ed955847213b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:00.586998 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e1196ea9-8b14-4aca-a572-ed955847213b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:00.617029 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e1196ea9-8b14-4aca-a572-ed955847213b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043863 Jun 23 22:43:00.621774 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 356/733] 10.222.0.43 () {58 vars in 1301 bytes} [Thu Jun 23 22:43:00 2022] GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:43:00.782880 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-f962cd5c-2617-445c-ac05-ad823dad817f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:00.783432 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-f962cd5c-2617-445c-ac05-ad823dad817f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:00.789864 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f962cd5c-2617-445c-ac05-ad823dad817f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:00.790334 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f962cd5c-2617-445c-ac05-ad823dad817f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:00.791391 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f962cd5c-2617-445c-ac05-ad823dad817f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:00.791823 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f962cd5c-2617-445c-ac05-ad823dad817f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:00.945430 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-f962cd5c-2617-445c-ac05-ad823dad817f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:00.949032 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:43:00.959324 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-f962cd5c-2617-445c-ac05-ad823dad817f tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1561 microversion: 2.1 time: 0.179955 Jun 23 22:43:00.959900 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 378/734] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:43:00 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1561 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:43:01.629257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-64586b18-70a5-4ec5-a186-70157d993449 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:01.630206 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-64586b18-70a5-4ec5-a186-70157d993449 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:01.636784 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-64586b18-70a5-4ec5-a186-70157d993449 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:01.637275 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-64586b18-70a5-4ec5-a186-70157d993449 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:01.638008 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-64586b18-70a5-4ec5-a186-70157d993449 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:01.638440 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-64586b18-70a5-4ec5-a186-70157d993449 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:01.666807 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-64586b18-70a5-4ec5-a186-70157d993449 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041495 Jun 23 22:43:01.667405 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 357/735] 10.222.0.43 () {58 vars in 1301 bytes} [Thu Jun 23 22:43:01 2022] GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 22:43:01.729720 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-0a87292c-cdaa-49ac-ae5b-7d2969d8b3a8 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:01.730204 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-0a87292c-cdaa-49ac-ae5b-7d2969d8b3a8 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:01.737554 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-0a87292c-cdaa-49ac-ae5b-7d2969d8b3a8 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:01.738105 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-0a87292c-cdaa-49ac-ae5b-7d2969d8b3a8 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:01.738862 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-0a87292c-cdaa-49ac-ae5b-7d2969d8b3a8 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:01.739308 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-0a87292c-cdaa-49ac-ae5b-7d2969d8b3a8 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:01.764638 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-0a87292c-cdaa-49ac-ae5b-7d2969d8b3a8 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4] Going to try to terminate instance {{(pid=124357) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:43:01.840951 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-0a87292c-cdaa-49ac-ae5b-7d2969d8b3a8 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4" status: 204 len: 0 microversion: 2.1 time: 0.115628 Jun 23 22:43:01.844968 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 379/736] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 23 22:43:01 2022] DELETE /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 22:43:01.850150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-6705ee3d-7750-494d-986e-31adc5cb9428 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:01.850769 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-6705ee3d-7750-494d-986e-31adc5cb9428 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:01.859271 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6705ee3d-7750-494d-986e-31adc5cb9428 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:01.859819 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6705ee3d-7750-494d-986e-31adc5cb9428 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:01.861112 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6705ee3d-7750-494d-986e-31adc5cb9428 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:01.862068 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6705ee3d-7750-494d-986e-31adc5cb9428 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:01.998847 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-6705ee3d-7750-494d-986e-31adc5cb9428 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:02.006375 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-6705ee3d-7750-494d-986e-31adc5cb9428 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4" status: 200 len: 1680 microversion: 2.1 time: 0.159970 Jun 23 22:43:02.006967 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 358/737] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:43:01 2022] GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:43:03.023778 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-6faa85e1-a488-4c92-9a6b-d89d151c3410 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:03.024474 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-6faa85e1-a488-4c92-9a6b-d89d151c3410 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:03.031362 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6faa85e1-a488-4c92-9a6b-d89d151c3410 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:03.031802 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6faa85e1-a488-4c92-9a6b-d89d151c3410 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:03.032555 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6faa85e1-a488-4c92-9a6b-d89d151c3410 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:03.032981 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6faa85e1-a488-4c92-9a6b-d89d151c3410 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:03.173390 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-6faa85e1-a488-4c92-9a6b-d89d151c3410 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:03.180985 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-6faa85e1-a488-4c92-9a6b-d89d151c3410 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4" status: 200 len: 1680 microversion: 2.1 time: 0.161930 Jun 23 22:43:03.181570 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 380/738] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:43:03 2022] GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:43:04.197831 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-8c07e2ca-cc42-4cb6-9ca3-0e269b39600e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:04.198373 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-8c07e2ca-cc42-4cb6-9ca3-0e269b39600e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:04.205785 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8c07e2ca-cc42-4cb6-9ca3-0e269b39600e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:04.206232 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8c07e2ca-cc42-4cb6-9ca3-0e269b39600e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:04.207045 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8c07e2ca-cc42-4cb6-9ca3-0e269b39600e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:04.207479 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8c07e2ca-cc42-4cb6-9ca3-0e269b39600e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:04.482629 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-8c07e2ca-cc42-4cb6-9ca3-0e269b39600e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:04.490658 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-8c07e2ca-cc42-4cb6-9ca3-0e269b39600e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4" status: 200 len: 1680 microversion: 2.1 time: 0.296687 Jun 23 22:43:04.491270 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 359/739] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:43:04 2022] GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 => generated 1680 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:43:04.981263 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [req-4688b425-5e62-4aae-a182-9d13f42075fb req-cdd6adaf-d6fa-4a8f-b7fa-d402d91f31b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4", "name": "network-vif-deleted", "tag": "f62d6650-e1ce-4156-9949-4d5a16040e59"}]} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:43:04.992039 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-4688b425-5e62-4aae-a182-9d13f42075fb req-cdd6adaf-d6fa-4a8f-b7fa-d402d91f31b3 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:04.992818 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-4688b425-5e62-4aae-a182-9d13f42075fb req-cdd6adaf-d6fa-4a8f-b7fa-d402d91f31b3 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:05.012013 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.compute.server_external_events [req-4688b425-5e62-4aae-a182-9d13f42075fb req-cdd6adaf-d6fa-4a8f-b7fa-d402d91f31b3 service nova] Creating event network-vif-deleted:f62d6650-e1ce-4156-9949-4d5a16040e59 for instance ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 on hv-cinder-84617 Jun 23 22:43:05.018045 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [req-4688b425-5e62-4aae-a182-9d13f42075fb req-cdd6adaf-d6fa-4a8f-b7fa-d402d91f31b3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040837 Jun 23 22:43:05.018756 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 381/740] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:43:05.508434 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-710d6561-f522-4f62-83c7-55e28b07bc53 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:05.509042 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-710d6561-f522-4f62-83c7-55e28b07bc53 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:05.519492 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-710d6561-f522-4f62-83c7-55e28b07bc53 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:05.520296 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-710d6561-f522-4f62-83c7-55e28b07bc53 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:05.521438 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-710d6561-f522-4f62-83c7-55e28b07bc53 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:05.523084 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-710d6561-f522-4f62-83c7-55e28b07bc53 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:05.564604 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-710d6561-f522-4f62-83c7-55e28b07bc53 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:05.565046 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-710d6561-f522-4f62-83c7-55e28b07bc53 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:05.565491 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.objects.instance [None req-710d6561-f522-4f62-83c7-55e28b07bc53 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lazy-loading 'fault' on Instance uuid ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 {{(pid=124358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:43:05.608709 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-710d6561-f522-4f62-83c7-55e28b07bc53 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03486c7630314392b85271455d12aba2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2735e40fe2564a6d8a5cdc7c32b0b869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:05.617827 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-710d6561-f522-4f62-83c7-55e28b07bc53 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4" status: 200 len: 1330 microversion: 2.1 time: 0.112985 Jun 23 22:43:05.618763 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 360/741] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:43:05 2022] GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 => generated 1330 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:43:06.637453 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-959fd193-f2b1-4763-bade-0fc7087c3650 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:06.638757 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-959fd193-f2b1-4763-bade-0fc7087c3650 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:06.644918 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-959fd193-f2b1-4763-bade-0fc7087c3650 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:06.645362 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-959fd193-f2b1-4763-bade-0fc7087c3650 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:06.646147 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-959fd193-f2b1-4763-bade-0fc7087c3650 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:06.646578 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-959fd193-f2b1-4763-bade-0fc7087c3650 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:06.660396 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.wsgi [None req-959fd193-f2b1-4763-bade-0fc7087c3650 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] HTTP exception thrown: Instance ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 could not be found. Jun 23 22:43:06.662000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-959fd193-f2b1-4763-bade-0fc7087c3650 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Request method failure captured: Jun 23 22:43:06.662000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: request: GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 HTTP/1.1 Jun 23 22:43:06.662000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept: application/json Jun 23 22:43:06.662000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept-Encoding: identity Jun 23 22:43:06.662000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Connection: close Jun 23 22:43:06.662000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Length: 0 Jun 23 22:43:06.662000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Type: application/json Jun 23 22:43:06.662000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Host: 10.222.0.43 Jun 23 22:43:06.662000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Openstack-System-Scope: None Jun 23 22:43:06.662000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: User-Agent: python-urllib3/1.26.9 Jun 23 22:43:06.662000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Auth-Token: gAAAAABitOrWyDITCi2PmBTdDblZ-ZSwK9B2UK_lIIWOMJB9Z-7YhxsoOI1DrhAeUCIChTCXv2hii5VV1HcTnkYXbW5bgXE95MCdJVwhuPtEsdt8Afqc-N7hZn6zZkza9EI9jSK71KcKdXUQCp4unsH4J6JfPLYATxcY6NVUnHVlcszTDCqSUi0 Jun 23 22:43:06.662000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Id: None Jun 23 22:43:06.662000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Name: None Jun 23 22:43:06.662000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Identity-Status: Confirmed Jun 23 22:43:06.662000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Is-Admin-Project: True Jun 23 22:43:06.662000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Id: default Jun 23 22:43:06.662000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Name: Default Jun 23 22:43:06.662000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Id: 2735e40fe2564a6d8a5cdc7c32b0b869 Jun 23 22:43:06.662000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Name: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:43:06.662000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Role: reader,member Jun 23 22:43:06.662000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Roles: reader,member Jun 23 22:43:06.663421 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2735e40fe2564a6d8a5cdc7c32b0b869", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:43:06.663421 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:43:06.663421 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Id: 2735e40fe2564a6d8a5cdc7c32b0b869 Jun 23 22:43:06.663421 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:43:06.663421 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User: tempest-AttachVolumeNegativeTest-184787456-project Jun 23 22:43:06.663421 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Id: default Jun 23 22:43:06.663421 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Name: Default Jun 23 22:43:06.663421 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Id: 03486c7630314392b85271455d12aba2 Jun 23 22:43:06.663421 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Name: tempest-AttachVolumeNegativeTest-184787456-project Jun 23 22:43:06.663421 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: method: > Jun 23 22:43:06.663421 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: exception: Instance ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 could not be found. Jun 23 22:43:06.663421 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: action_args: {'id': 'ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4'} Jun 23 22:43:06.664208 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:43:06.664208 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:43:06.664208 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:43:06.664208 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:43:06.664208 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:43:06.664208 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:43:06.664208 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:43:06.664208 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:43:06.664208 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:43:06.664208 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:43:06.664208 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 could not be found. Jun 23 22:43:06.664208 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:43:06.664208 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:43:06.664208 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:43:06.664208 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:43:06.664208 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:43:06.664208 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:43:06.664208 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:43:06.664208 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:43:06.664208 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:43:06.665464 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:43:06.665464 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:43:06.665464 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:43:06.665464 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:43:06.665464 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:43:06.665464 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:43:06.665464 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:43:06.665464 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 could not be found. Jun 23 22:43:06.665464 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:43:06.665464 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:43:06.665464 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:43:06.665464 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:43:06.665464 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:43:06.665464 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:43:06.665464 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:43:06.665464 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:43:06.665464 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 could not be found. Jun 23 22:43:06.665464 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:43:06.667109 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-959fd193-f2b1-4763-bade-0fc7087c3650 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Returning 404 to user: Instance ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 could not be found. {{(pid=124357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:43:06.667109 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-959fd193-f2b1-4763-bade-0fc7087c3650 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4" status: 404 len: 111 microversion: 2.1 time: 0.031127 Jun 23 22:43:06.667109 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 382/742] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:43:06 2022] GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:43:06.673786 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-fe04abfe-b205-418f-b6d8-947ba4bbbf33 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '.version_select at 0x7fb7197020d0>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:06.692581 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-fe04abfe-b205-418f-b6d8-947ba4bbbf33 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-450586368" status: 202 len: 0 microversion: 2.1 time: 0.022443 Jun 23 22:43:06.693230 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 361/743] 10.222.0.43 () {58 vars in 1217 bytes} [Thu Jun 23 22:43:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-450586368 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:43:08.477358 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-624840b5-4bee-484f-8499-f8b381b875a1 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:08.477887 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-624840b5-4bee-484f-8499-f8b381b875a1 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:08.485104 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-624840b5-4bee-484f-8499-f8b381b875a1 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:08.485554 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-624840b5-4bee-484f-8499-f8b381b875a1 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:08.486322 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-624840b5-4bee-484f-8499-f8b381b875a1 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:08.486758 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-624840b5-4bee-484f-8499-f8b381b875a1 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:08.501723 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.wsgi [None req-624840b5-4bee-484f-8499-f8b381b875a1 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] HTTP exception thrown: Instance ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 could not be found. Jun 23 22:43:08.503357 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-624840b5-4bee-484f-8499-f8b381b875a1 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Request method failure captured: Jun 23 22:43:08.503357 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: request: DELETE /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 HTTP/1.1 Jun 23 22:43:08.503357 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept: application/json Jun 23 22:43:08.503357 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept-Encoding: identity Jun 23 22:43:08.503357 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Connection: close Jun 23 22:43:08.503357 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Length: 0 Jun 23 22:43:08.503357 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Type: application/json Jun 23 22:43:08.503357 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Host: 10.222.0.43 Jun 23 22:43:08.503357 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Openstack-System-Scope: None Jun 23 22:43:08.503357 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: User-Agent: python-urllib3/1.26.9 Jun 23 22:43:08.503357 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Auth-Token: gAAAAABitOrWyDITCi2PmBTdDblZ-ZSwK9B2UK_lIIWOMJB9Z-7YhxsoOI1DrhAeUCIChTCXv2hii5VV1HcTnkYXbW5bgXE95MCdJVwhuPtEsdt8Afqc-N7hZn6zZkza9EI9jSK71KcKdXUQCp4unsH4J6JfPLYATxcY6NVUnHVlcszTDCqSUi0 Jun 23 22:43:08.503357 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Id: None Jun 23 22:43:08.503357 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Name: None Jun 23 22:43:08.503357 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Identity-Status: Confirmed Jun 23 22:43:08.503357 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Is-Admin-Project: True Jun 23 22:43:08.503357 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Id: default Jun 23 22:43:08.503357 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Name: Default Jun 23 22:43:08.503357 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Id: 2735e40fe2564a6d8a5cdc7c32b0b869 Jun 23 22:43:08.503357 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Name: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:43:08.503357 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Role: reader,member Jun 23 22:43:08.503357 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Roles: reader,member Jun 23 22:43:08.504777 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2735e40fe2564a6d8a5cdc7c32b0b869", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:43:08.504777 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:43:08.504777 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Id: 2735e40fe2564a6d8a5cdc7c32b0b869 Jun 23 22:43:08.504777 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:43:08.504777 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User: tempest-AttachVolumeNegativeTest-184787456-project Jun 23 22:43:08.504777 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Id: default Jun 23 22:43:08.504777 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Name: Default Jun 23 22:43:08.504777 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Id: 03486c7630314392b85271455d12aba2 Jun 23 22:43:08.504777 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Name: tempest-AttachVolumeNegativeTest-184787456-project Jun 23 22:43:08.504777 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: method: > Jun 23 22:43:08.504777 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: exception: Instance ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 could not be found. Jun 23 22:43:08.504777 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: action_args: {'id': 'ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4'} Jun 23 22:43:08.505950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:43:08.505950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:43:08.505950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:43:08.505950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:43:08.505950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:43:08.505950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:43:08.505950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:43:08.505950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:43:08.505950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:43:08.505950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:43:08.505950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 could not be found. Jun 23 22:43:08.505950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:43:08.505950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:43:08.505950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:43:08.505950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:43:08.505950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:43:08.505950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:43:08.505950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:43:08.505950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:43:08.505950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:43:08.507716 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:43:08.507716 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 22:43:08.507716 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 22:43:08.507716 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 22:43:08.507716 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 22:43:08.507716 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:43:08.507716 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:43:08.507716 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:43:08.507716 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:43:08.507716 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 could not be found. Jun 23 22:43:08.507716 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:43:08.507716 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:43:08.507716 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:43:08.507716 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:43:08.507716 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:43:08.507716 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:43:08.507716 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:43:08.507716 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:43:08.507716 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 could not be found. Jun 23 22:43:08.507716 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:43:08.509412 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-624840b5-4bee-484f-8499-f8b381b875a1 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Returning 404 to user: Instance ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 could not be found. {{(pid=124357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:43:08.509412 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-624840b5-4bee-484f-8499-f8b381b875a1 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4" status: 404 len: 111 microversion: 2.1 time: 0.031345 Jun 23 22:43:08.509412 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 383/744] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 23 22:43:08 2022] DELETE /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:43:08.514427 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d9eb3a3f-c2b1-445a-ad6a-79a32dec1881 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:08.515078 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-d9eb3a3f-c2b1-445a-ad6a-79a32dec1881 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:08.522303 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d9eb3a3f-c2b1-445a-ad6a-79a32dec1881 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:08.522750 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d9eb3a3f-c2b1-445a-ad6a-79a32dec1881 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:08.523552 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d9eb3a3f-c2b1-445a-ad6a-79a32dec1881 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:08.523985 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d9eb3a3f-c2b1-445a-ad6a-79a32dec1881 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:08.537180 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-d9eb3a3f-c2b1-445a-ad6a-79a32dec1881 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] HTTP exception thrown: Instance ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 could not be found. Jun 23 22:43:08.538712 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d9eb3a3f-c2b1-445a-ad6a-79a32dec1881 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Request method failure captured: Jun 23 22:43:08.538712 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: request: GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 HTTP/1.1 Jun 23 22:43:08.538712 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept: application/json Jun 23 22:43:08.538712 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Jun 23 22:43:08.538712 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Connection: close Jun 23 22:43:08.538712 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Length: 0 Jun 23 22:43:08.538712 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Type: application/json Jun 23 22:43:08.538712 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Host: 10.222.0.43 Jun 23 22:43:08.538712 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Jun 23 22:43:08.538712 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.9 Jun 23 22:43:08.538712 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABitOrWyDITCi2PmBTdDblZ-ZSwK9B2UK_lIIWOMJB9Z-7YhxsoOI1DrhAeUCIChTCXv2hii5VV1HcTnkYXbW5bgXE95MCdJVwhuPtEsdt8Afqc-N7hZn6zZkza9EI9jSK71KcKdXUQCp4unsH4J6JfPLYATxcY6NVUnHVlcszTDCqSUi0 Jun 23 22:43:08.538712 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Jun 23 22:43:08.538712 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Jun 23 22:43:08.538712 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Jun 23 22:43:08.538712 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Jun 23 22:43:08.538712 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Jun 23 22:43:08.538712 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Jun 23 22:43:08.538712 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Id: 2735e40fe2564a6d8a5cdc7c32b0b869 Jun 23 22:43:08.538712 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:43:08.538712 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Role: reader,member Jun 23 22:43:08.538712 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Roles: reader,member Jun 23 22:43:08.541426 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2735e40fe2564a6d8a5cdc7c32b0b869", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:43:08.541426 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:43:08.541426 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Id: 2735e40fe2564a6d8a5cdc7c32b0b869 Jun 23 22:43:08.541426 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:43:08.541426 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User: tempest-AttachVolumeNegativeTest-184787456-project Jun 23 22:43:08.541426 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Jun 23 22:43:08.541426 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Jun 23 22:43:08.541426 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Id: 03486c7630314392b85271455d12aba2 Jun 23 22:43:08.541426 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-AttachVolumeNegativeTest-184787456-project Jun 23 22:43:08.541426 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: method: > Jun 23 22:43:08.541426 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: exception: Instance ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 could not be found. Jun 23 22:43:08.541426 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: action_args: {'id': 'ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4'} Jun 23 22:43:08.542257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:43:08.542257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:43:08.542257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:43:08.542257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:43:08.542257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:43:08.542257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:43:08.542257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:43:08.542257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:43:08.542257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:43:08.542257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:43:08.542257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 could not be found. Jun 23 22:43:08.542257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:43:08.542257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:43:08.542257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:43:08.542257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:43:08.542257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:43:08.542257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:43:08.542257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:43:08.542257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:43:08.542257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:43:08.543977 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:43:08.543977 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:43:08.543977 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:43:08.543977 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:43:08.543977 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:43:08.543977 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:43:08.543977 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:43:08.543977 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 could not be found. Jun 23 22:43:08.543977 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:43:08.543977 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:43:08.543977 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:43:08.543977 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:43:08.543977 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:43:08.543977 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:43:08.543977 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:43:08.543977 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:43:08.543977 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 could not be found. Jun 23 22:43:08.543977 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:43:08.545451 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d9eb3a3f-c2b1-445a-ad6a-79a32dec1881 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Returning 404 to user: Instance ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:43:08.545451 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d9eb3a3f-c2b1-445a-ad6a-79a32dec1881 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4" status: 404 len: 111 microversion: 2.1 time: 0.030189 Jun 23 22:43:08.545451 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 362/745] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:43:08 2022] GET /compute/v2.1/servers/ca2fd4a8-b5d5-4139-bb33-e23e1c5344d4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:43:09.525904 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-a9f54c8d-0586-4700-ba32-4c265fad1a2e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:09.526465 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-a9f54c8d-0586-4700-ba32-4c265fad1a2e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:09.532924 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a9f54c8d-0586-4700-ba32-4c265fad1a2e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:09.533369 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a9f54c8d-0586-4700-ba32-4c265fad1a2e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:09.534127 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a9f54c8d-0586-4700-ba32-4c265fad1a2e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:09.534558 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a9f54c8d-0586-4700-ba32-4c265fad1a2e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:09.559440 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-a9f54c8d-0586-4700-ba32-4c265fad1a2e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3/ips" status: 200 len: 151 microversion: 2.20 time: 0.036852 Jun 23 22:43:09.560192 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 384/746] 10.222.0.43 () {60 vars in 1288 bytes} [Thu Jun 23 22:43:09 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 22:43:09.689818 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-8c44e9d9-572e-4303-aa7c-9bbd01276c81 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:09.690397 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-8c44e9d9-572e-4303-aa7c-9bbd01276c81 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: e085b10f-a993-4e81-963d-0006a6431b67] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:09.697188 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8c44e9d9-572e-4303-aa7c-9bbd01276c81 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:09.697639 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8c44e9d9-572e-4303-aa7c-9bbd01276c81 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:09.698415 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8c44e9d9-572e-4303-aa7c-9bbd01276c81 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:09.698852 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8c44e9d9-572e-4303-aa7c-9bbd01276c81 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:09.715827 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-8c44e9d9-572e-4303-aa7c-9bbd01276c81 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] HTTP exception thrown: Instance e085b10f-a993-4e81-963d-0006a6431b67 could not be found. Jun 23 22:43:09.717318 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-8c44e9d9-572e-4303-aa7c-9bbd01276c81 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Request method failure captured: Jun 23 22:43:09.717318 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: request: DELETE /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67 HTTP/1.1 Jun 23 22:43:09.717318 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept: application/json Jun 23 22:43:09.717318 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Jun 23 22:43:09.717318 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Connection: close Jun 23 22:43:09.717318 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Length: 0 Jun 23 22:43:09.717318 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Type: application/json Jun 23 22:43:09.717318 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Host: 10.222.0.43 Jun 23 22:43:09.717318 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Jun 23 22:43:09.717318 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.9 Jun 23 22:43:09.717318 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABitOrWyDITCi2PmBTdDblZ-ZSwK9B2UK_lIIWOMJB9Z-7YhxsoOI1DrhAeUCIChTCXv2hii5VV1HcTnkYXbW5bgXE95MCdJVwhuPtEsdt8Afqc-N7hZn6zZkza9EI9jSK71KcKdXUQCp4unsH4J6JfPLYATxcY6NVUnHVlcszTDCqSUi0 Jun 23 22:43:09.717318 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Jun 23 22:43:09.717318 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Jun 23 22:43:09.717318 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Jun 23 22:43:09.717318 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Jun 23 22:43:09.717318 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Jun 23 22:43:09.717318 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Jun 23 22:43:09.717318 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Id: 2735e40fe2564a6d8a5cdc7c32b0b869 Jun 23 22:43:09.717318 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:43:09.717318 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Role: reader,member Jun 23 22:43:09.717318 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Roles: reader,member Jun 23 22:43:09.718889 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2735e40fe2564a6d8a5cdc7c32b0b869", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:43:09.718889 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:43:09.718889 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Id: 2735e40fe2564a6d8a5cdc7c32b0b869 Jun 23 22:43:09.718889 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:43:09.718889 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User: tempest-AttachVolumeNegativeTest-184787456-project Jun 23 22:43:09.718889 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Jun 23 22:43:09.718889 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Jun 23 22:43:09.718889 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Id: 03486c7630314392b85271455d12aba2 Jun 23 22:43:09.718889 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-AttachVolumeNegativeTest-184787456-project Jun 23 22:43:09.718889 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: method: > Jun 23 22:43:09.718889 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: exception: Instance e085b10f-a993-4e81-963d-0006a6431b67 could not be found. Jun 23 22:43:09.718889 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: action_args: {'id': 'e085b10f-a993-4e81-963d-0006a6431b67'} Jun 23 22:43:09.719827 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:43:09.719827 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:43:09.719827 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:43:09.719827 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:43:09.719827 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:43:09.719827 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:43:09.719827 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:43:09.719827 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:43:09.719827 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:43:09.719827 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:43:09.719827 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e085b10f-a993-4e81-963d-0006a6431b67 could not be found. Jun 23 22:43:09.719827 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:43:09.719827 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:43:09.719827 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:43:09.719827 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:43:09.719827 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:43:09.719827 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:43:09.719827 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:43:09.719827 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:43:09.719827 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:43:09.721191 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:43:09.721191 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 22:43:09.721191 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 22:43:09.721191 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 22:43:09.721191 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 22:43:09.721191 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:43:09.721191 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:43:09.721191 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:43:09.721191 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:43:09.721191 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e085b10f-a993-4e81-963d-0006a6431b67 could not be found. Jun 23 22:43:09.721191 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:43:09.721191 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:43:09.721191 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:43:09.721191 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:43:09.721191 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:43:09.721191 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:43:09.721191 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:43:09.721191 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:43:09.721191 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e085b10f-a993-4e81-963d-0006a6431b67 could not be found. Jun 23 22:43:09.721191 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:43:09.724626 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-8c44e9d9-572e-4303-aa7c-9bbd01276c81 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Returning 404 to user: Instance e085b10f-a993-4e81-963d-0006a6431b67 could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:43:09.725704 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-8c44e9d9-572e-4303-aa7c-9bbd01276c81 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67" status: 404 len: 111 microversion: 2.1 time: 0.039927 Jun 23 22:43:09.726581 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 363/747] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 23 22:43:09 2022] DELETE /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:43:09.735754 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-f7d3894c-0829-43eb-85fb-4186aa311f4e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:09.736606 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-f7d3894c-0829-43eb-85fb-4186aa311f4e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: e085b10f-a993-4e81-963d-0006a6431b67] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:09.743053 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f7d3894c-0829-43eb-85fb-4186aa311f4e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:09.743514 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f7d3894c-0829-43eb-85fb-4186aa311f4e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:09.744433 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f7d3894c-0829-43eb-85fb-4186aa311f4e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:09.744876 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f7d3894c-0829-43eb-85fb-4186aa311f4e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:09.764616 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.wsgi [None req-f7d3894c-0829-43eb-85fb-4186aa311f4e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] HTTP exception thrown: Instance e085b10f-a993-4e81-963d-0006a6431b67 could not be found. Jun 23 22:43:09.766964 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-f7d3894c-0829-43eb-85fb-4186aa311f4e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Request method failure captured: Jun 23 22:43:09.766964 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: request: GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67 HTTP/1.1 Jun 23 22:43:09.766964 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept: application/json Jun 23 22:43:09.766964 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept-Encoding: identity Jun 23 22:43:09.766964 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Connection: close Jun 23 22:43:09.766964 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Length: 0 Jun 23 22:43:09.766964 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Type: application/json Jun 23 22:43:09.766964 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Host: 10.222.0.43 Jun 23 22:43:09.766964 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Openstack-System-Scope: None Jun 23 22:43:09.766964 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: User-Agent: python-urllib3/1.26.9 Jun 23 22:43:09.766964 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Auth-Token: gAAAAABitOrWyDITCi2PmBTdDblZ-ZSwK9B2UK_lIIWOMJB9Z-7YhxsoOI1DrhAeUCIChTCXv2hii5VV1HcTnkYXbW5bgXE95MCdJVwhuPtEsdt8Afqc-N7hZn6zZkza9EI9jSK71KcKdXUQCp4unsH4J6JfPLYATxcY6NVUnHVlcszTDCqSUi0 Jun 23 22:43:09.766964 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Id: None Jun 23 22:43:09.766964 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Name: None Jun 23 22:43:09.766964 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Identity-Status: Confirmed Jun 23 22:43:09.766964 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Is-Admin-Project: True Jun 23 22:43:09.766964 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Id: default Jun 23 22:43:09.766964 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Name: Default Jun 23 22:43:09.766964 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Id: 2735e40fe2564a6d8a5cdc7c32b0b869 Jun 23 22:43:09.766964 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Name: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:43:09.766964 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Role: reader,member Jun 23 22:43:09.766964 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Roles: reader,member Jun 23 22:43:09.768383 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2735e40fe2564a6d8a5cdc7c32b0b869", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:43:09.768383 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:43:09.768383 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Id: 2735e40fe2564a6d8a5cdc7c32b0b869 Jun 23 22:43:09.768383 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:43:09.768383 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User: tempest-AttachVolumeNegativeTest-184787456-project Jun 23 22:43:09.768383 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Id: default Jun 23 22:43:09.768383 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Name: Default Jun 23 22:43:09.768383 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Id: 03486c7630314392b85271455d12aba2 Jun 23 22:43:09.768383 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Name: tempest-AttachVolumeNegativeTest-184787456-project Jun 23 22:43:09.768383 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: method: > Jun 23 22:43:09.768383 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: exception: Instance e085b10f-a993-4e81-963d-0006a6431b67 could not be found. Jun 23 22:43:09.768383 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: action_args: {'id': 'e085b10f-a993-4e81-963d-0006a6431b67'} Jun 23 22:43:09.769254 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:43:09.769254 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:43:09.769254 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:43:09.769254 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:43:09.769254 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:43:09.769254 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:43:09.769254 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:43:09.769254 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:43:09.769254 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:43:09.769254 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:43:09.769254 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e085b10f-a993-4e81-963d-0006a6431b67 could not be found. Jun 23 22:43:09.769254 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:43:09.769254 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:43:09.769254 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:43:09.769254 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:43:09.769254 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:43:09.769254 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:43:09.769254 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:43:09.769254 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:43:09.769254 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:43:09.770502 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:43:09.770502 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:43:09.770502 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:43:09.770502 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:43:09.770502 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:43:09.770502 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:43:09.770502 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:43:09.770502 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e085b10f-a993-4e81-963d-0006a6431b67 could not be found. Jun 23 22:43:09.770502 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:43:09.770502 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:43:09.770502 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:43:09.770502 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:43:09.770502 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:43:09.770502 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:43:09.770502 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:43:09.770502 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:43:09.770502 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e085b10f-a993-4e81-963d-0006a6431b67 could not be found. Jun 23 22:43:09.770502 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:43:09.773688 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-f7d3894c-0829-43eb-85fb-4186aa311f4e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Returning 404 to user: Instance e085b10f-a993-4e81-963d-0006a6431b67 could not be found. {{(pid=124357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:43:09.773688 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-f7d3894c-0829-43eb-85fb-4186aa311f4e tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67" status: 404 len: 111 microversion: 2.1 time: 0.037018 Jun 23 22:43:09.773688 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 385/748] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:43:09 2022] GET /compute/v2.1/servers/e085b10f-a993-4e81-963d-0006a6431b67 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:43:09.779879 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-82df802b-a84e-4413-8702-ba707492dfbe tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:09.780398 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-82df802b-a84e-4413-8702-ba707492dfbe tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: 384878db-4705-4f7b-87ff-0f079208412f] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:09.787337 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-82df802b-a84e-4413-8702-ba707492dfbe tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:09.787753 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-82df802b-a84e-4413-8702-ba707492dfbe tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:09.788527 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-82df802b-a84e-4413-8702-ba707492dfbe tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:09.789141 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-82df802b-a84e-4413-8702-ba707492dfbe tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:09.818446 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-82df802b-a84e-4413-8702-ba707492dfbe tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] HTTP exception thrown: Instance 384878db-4705-4f7b-87ff-0f079208412f could not be found. Jun 23 22:43:09.820257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-82df802b-a84e-4413-8702-ba707492dfbe tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Request method failure captured: Jun 23 22:43:09.820257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: request: DELETE /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f HTTP/1.1 Jun 23 22:43:09.820257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept: application/json Jun 23 22:43:09.820257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Jun 23 22:43:09.820257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Connection: close Jun 23 22:43:09.820257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Length: 0 Jun 23 22:43:09.820257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Type: application/json Jun 23 22:43:09.820257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Host: 10.222.0.43 Jun 23 22:43:09.820257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Jun 23 22:43:09.820257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.9 Jun 23 22:43:09.820257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABitOrWyDITCi2PmBTdDblZ-ZSwK9B2UK_lIIWOMJB9Z-7YhxsoOI1DrhAeUCIChTCXv2hii5VV1HcTnkYXbW5bgXE95MCdJVwhuPtEsdt8Afqc-N7hZn6zZkza9EI9jSK71KcKdXUQCp4unsH4J6JfPLYATxcY6NVUnHVlcszTDCqSUi0 Jun 23 22:43:09.820257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Jun 23 22:43:09.820257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Jun 23 22:43:09.820257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Jun 23 22:43:09.820257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Jun 23 22:43:09.820257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Jun 23 22:43:09.820257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Jun 23 22:43:09.820257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Id: 2735e40fe2564a6d8a5cdc7c32b0b869 Jun 23 22:43:09.820257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:43:09.820257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Role: reader,member Jun 23 22:43:09.820257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Roles: reader,member Jun 23 22:43:09.821913 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2735e40fe2564a6d8a5cdc7c32b0b869", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:43:09.821913 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:43:09.821913 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Id: 2735e40fe2564a6d8a5cdc7c32b0b869 Jun 23 22:43:09.821913 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:43:09.821913 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User: tempest-AttachVolumeNegativeTest-184787456-project Jun 23 22:43:09.821913 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Jun 23 22:43:09.821913 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Jun 23 22:43:09.821913 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Id: 03486c7630314392b85271455d12aba2 Jun 23 22:43:09.821913 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-AttachVolumeNegativeTest-184787456-project Jun 23 22:43:09.821913 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: method: > Jun 23 22:43:09.821913 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: exception: Instance 384878db-4705-4f7b-87ff-0f079208412f could not be found. Jun 23 22:43:09.821913 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: action_args: {'id': '384878db-4705-4f7b-87ff-0f079208412f'} Jun 23 22:43:09.822944 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:43:09.822944 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:43:09.822944 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:43:09.822944 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:43:09.822944 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:43:09.822944 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:43:09.822944 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:43:09.822944 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:43:09.822944 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:43:09.822944 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:43:09.822944 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 384878db-4705-4f7b-87ff-0f079208412f could not be found. Jun 23 22:43:09.822944 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:43:09.822944 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:43:09.822944 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:43:09.822944 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:43:09.822944 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:43:09.822944 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:43:09.822944 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:43:09.822944 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:43:09.822944 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:43:09.825027 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:43:09.825027 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 22:43:09.825027 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 22:43:09.825027 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 22:43:09.825027 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 22:43:09.825027 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:43:09.825027 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:43:09.825027 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:43:09.825027 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:43:09.825027 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 384878db-4705-4f7b-87ff-0f079208412f could not be found. Jun 23 22:43:09.825027 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:43:09.825027 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:43:09.825027 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:43:09.825027 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:43:09.825027 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:43:09.825027 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:43:09.825027 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:43:09.825027 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:43:09.825027 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 384878db-4705-4f7b-87ff-0f079208412f could not be found. Jun 23 22:43:09.825027 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:43:09.828170 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-82df802b-a84e-4413-8702-ba707492dfbe tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Returning 404 to user: Instance 384878db-4705-4f7b-87ff-0f079208412f could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:43:09.829186 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-82df802b-a84e-4413-8702-ba707492dfbe tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "DELETE /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f" status: 404 len: 111 microversion: 2.1 time: 0.053247 Jun 23 22:43:09.829740 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 364/749] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 23 22:43:09 2022] DELETE /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:43:09.838323 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-130cb2d7-1c03-4663-863d-57d9d062e3be tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:09.839158 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-130cb2d7-1c03-4663-863d-57d9d062e3be tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: 384878db-4705-4f7b-87ff-0f079208412f] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:09.845844 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-130cb2d7-1c03-4663-863d-57d9d062e3be tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:09.846285 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-130cb2d7-1c03-4663-863d-57d9d062e3be tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:09.847444 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-130cb2d7-1c03-4663-863d-57d9d062e3be tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:09.848061 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-130cb2d7-1c03-4663-863d-57d9d062e3be tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:09.863114 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.wsgi [None req-130cb2d7-1c03-4663-863d-57d9d062e3be tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] HTTP exception thrown: Instance 384878db-4705-4f7b-87ff-0f079208412f could not be found. Jun 23 22:43:09.864765 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-130cb2d7-1c03-4663-863d-57d9d062e3be tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Request method failure captured: Jun 23 22:43:09.864765 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: request: GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f HTTP/1.1 Jun 23 22:43:09.864765 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept: application/json Jun 23 22:43:09.864765 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept-Encoding: identity Jun 23 22:43:09.864765 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Connection: close Jun 23 22:43:09.864765 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Length: 0 Jun 23 22:43:09.864765 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Type: application/json Jun 23 22:43:09.864765 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Host: 10.222.0.43 Jun 23 22:43:09.864765 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Openstack-System-Scope: None Jun 23 22:43:09.864765 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: User-Agent: python-urllib3/1.26.9 Jun 23 22:43:09.864765 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Auth-Token: gAAAAABitOrWyDITCi2PmBTdDblZ-ZSwK9B2UK_lIIWOMJB9Z-7YhxsoOI1DrhAeUCIChTCXv2hii5VV1HcTnkYXbW5bgXE95MCdJVwhuPtEsdt8Afqc-N7hZn6zZkza9EI9jSK71KcKdXUQCp4unsH4J6JfPLYATxcY6NVUnHVlcszTDCqSUi0 Jun 23 22:43:09.864765 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Id: None Jun 23 22:43:09.864765 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Name: None Jun 23 22:43:09.864765 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Identity-Status: Confirmed Jun 23 22:43:09.864765 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Is-Admin-Project: True Jun 23 22:43:09.864765 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Id: default Jun 23 22:43:09.864765 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Name: Default Jun 23 22:43:09.864765 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Id: 2735e40fe2564a6d8a5cdc7c32b0b869 Jun 23 22:43:09.864765 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Name: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:43:09.864765 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Role: reader,member Jun 23 22:43:09.864765 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Roles: reader,member Jun 23 22:43:09.866219 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2735e40fe2564a6d8a5cdc7c32b0b869", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:43:09.866219 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:43:09.866219 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Id: 2735e40fe2564a6d8a5cdc7c32b0b869 Jun 23 22:43:09.866219 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:43:09.866219 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User: tempest-AttachVolumeNegativeTest-184787456-project Jun 23 22:43:09.866219 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Id: default Jun 23 22:43:09.866219 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Name: Default Jun 23 22:43:09.866219 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Id: 03486c7630314392b85271455d12aba2 Jun 23 22:43:09.866219 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Name: tempest-AttachVolumeNegativeTest-184787456-project Jun 23 22:43:09.866219 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: method: > Jun 23 22:43:09.866219 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: exception: Instance 384878db-4705-4f7b-87ff-0f079208412f could not be found. Jun 23 22:43:09.866219 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: action_args: {'id': '384878db-4705-4f7b-87ff-0f079208412f'} Jun 23 22:43:09.867345 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:43:09.867345 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:43:09.867345 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:43:09.867345 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:43:09.867345 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:43:09.867345 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:43:09.867345 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:43:09.867345 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:43:09.867345 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:43:09.867345 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:43:09.867345 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 384878db-4705-4f7b-87ff-0f079208412f could not be found. Jun 23 22:43:09.867345 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:43:09.867345 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:43:09.867345 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:43:09.867345 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:43:09.867345 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:43:09.867345 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:43:09.867345 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:43:09.867345 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:43:09.867345 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:43:09.868957 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:43:09.868957 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:43:09.868957 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:43:09.868957 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:43:09.868957 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:43:09.868957 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:43:09.868957 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:43:09.868957 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 384878db-4705-4f7b-87ff-0f079208412f could not be found. Jun 23 22:43:09.868957 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:43:09.868957 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:43:09.868957 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:43:09.868957 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:43:09.868957 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:43:09.868957 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:43:09.868957 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:43:09.868957 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:43:09.868957 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 384878db-4705-4f7b-87ff-0f079208412f could not be found. Jun 23 22:43:09.868957 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:43:09.870814 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-130cb2d7-1c03-4663-863d-57d9d062e3be tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Returning 404 to user: Instance 384878db-4705-4f7b-87ff-0f079208412f could not be found. {{(pid=124357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:43:09.870814 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-130cb2d7-1c03-4663-863d-57d9d062e3be tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f" status: 404 len: 111 microversion: 2.1 time: 0.032332 Jun 23 22:43:09.870814 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 386/750] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:43:09 2022] GET /compute/v2.1/servers/384878db-4705-4f7b-87ff-0f079208412f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:43:11.039268 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a4b4b3e2-dc9b-4bd7-af71-d1a67023a21b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:11.039750 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-a4b4b3e2-dc9b-4bd7-af71-d1a67023a21b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: cd22650e-6851-4f81-a8d4-e4c7ade26c73] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:11.047027 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a4b4b3e2-dc9b-4bd7-af71-d1a67023a21b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:11.047474 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a4b4b3e2-dc9b-4bd7-af71-d1a67023a21b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:11.048240 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a4b4b3e2-dc9b-4bd7-af71-d1a67023a21b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:11.048675 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a4b4b3e2-dc9b-4bd7-af71-d1a67023a21b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:11.061980 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-a4b4b3e2-dc9b-4bd7-af71-d1a67023a21b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] HTTP exception thrown: Instance cd22650e-6851-4f81-a8d4-e4c7ade26c73 could not be found. Jun 23 22:43:11.063554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a4b4b3e2-dc9b-4bd7-af71-d1a67023a21b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Request method failure captured: Jun 23 22:43:11.063554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: request: DELETE /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73 HTTP/1.1 Jun 23 22:43:11.063554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept: application/json Jun 23 22:43:11.063554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Jun 23 22:43:11.063554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Connection: close Jun 23 22:43:11.063554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Length: 0 Jun 23 22:43:11.063554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Type: application/json Jun 23 22:43:11.063554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Host: 10.222.0.43 Jun 23 22:43:11.063554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Jun 23 22:43:11.063554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.9 Jun 23 22:43:11.063554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABitOrWyDITCi2PmBTdDblZ-ZSwK9B2UK_lIIWOMJB9Z-7YhxsoOI1DrhAeUCIChTCXv2hii5VV1HcTnkYXbW5bgXE95MCdJVwhuPtEsdt8Afqc-N7hZn6zZkza9EI9jSK71KcKdXUQCp4unsH4J6JfPLYATxcY6NVUnHVlcszTDCqSUi0 Jun 23 22:43:11.063554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Jun 23 22:43:11.063554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Jun 23 22:43:11.063554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Jun 23 22:43:11.063554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Jun 23 22:43:11.063554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Jun 23 22:43:11.063554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Jun 23 22:43:11.063554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Id: 2735e40fe2564a6d8a5cdc7c32b0b869 Jun 23 22:43:11.063554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:43:11.063554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Role: reader,member Jun 23 22:43:11.063554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Roles: reader,member Jun 23 22:43:11.065103 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2735e40fe2564a6d8a5cdc7c32b0b869", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:43:11.065103 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:43:11.065103 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Id: 2735e40fe2564a6d8a5cdc7c32b0b869 Jun 23 22:43:11.065103 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:43:11.065103 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User: tempest-AttachVolumeNegativeTest-184787456-project Jun 23 22:43:11.065103 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Jun 23 22:43:11.065103 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Jun 23 22:43:11.065103 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Id: 03486c7630314392b85271455d12aba2 Jun 23 22:43:11.065103 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-AttachVolumeNegativeTest-184787456-project Jun 23 22:43:11.065103 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: method: > Jun 23 22:43:11.065103 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: exception: Instance cd22650e-6851-4f81-a8d4-e4c7ade26c73 could not be found. Jun 23 22:43:11.065103 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: action_args: {'id': 'cd22650e-6851-4f81-a8d4-e4c7ade26c73'} Jun 23 22:43:11.066131 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:43:11.066131 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:43:11.066131 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:43:11.066131 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:43:11.066131 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:43:11.066131 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:43:11.066131 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:43:11.066131 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:43:11.066131 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:43:11.066131 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:43:11.066131 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd22650e-6851-4f81-a8d4-e4c7ade26c73 could not be found. Jun 23 22:43:11.066131 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:43:11.066131 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:43:11.066131 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:43:11.066131 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:43:11.066131 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:43:11.066131 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:43:11.066131 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:43:11.066131 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:43:11.066131 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:43:11.067680 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:43:11.067680 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 22:43:11.067680 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 22:43:11.067680 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 22:43:11.067680 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 22:43:11.067680 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:43:11.067680 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:43:11.067680 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:43:11.067680 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:43:11.067680 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd22650e-6851-4f81-a8d4-e4c7ade26c73 could not be found. Jun 23 22:43:11.067680 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:43:11.067680 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:43:11.067680 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:43:11.067680 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:43:11.067680 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:43:11.067680 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:43:11.067680 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:43:11.067680 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:43:11.067680 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd22650e-6851-4f81-a8d4-e4c7ade26c73 could not be found. Jun 23 22:43:11.067680 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:43:11.069324 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a4b4b3e2-dc9b-4bd7-af71-d1a67023a21b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Returning 404 to user: Instance cd22650e-6851-4f81-a8d4-e4c7ade26c73 could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:43:11.069324 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-a4b4b3e2-dc9b-4bd7-af71-d1a67023a21b tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "DELETE /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73" status: 404 len: 111 microversion: 2.1 time: 0.029496 Jun 23 22:43:11.069324 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 365/751] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 23 22:43:11 2022] DELETE /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:43:11.073094 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-3a985395-6fdf-4edf-af73-b3f0ff96e1a9 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:11.073703 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-3a985395-6fdf-4edf-af73-b3f0ff96e1a9 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] [instance: cd22650e-6851-4f81-a8d4-e4c7ade26c73] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:11.080065 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3a985395-6fdf-4edf-af73-b3f0ff96e1a9 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:11.080498 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3a985395-6fdf-4edf-af73-b3f0ff96e1a9 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:11.081248 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3a985395-6fdf-4edf-af73-b3f0ff96e1a9 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:11.081672 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3a985395-6fdf-4edf-af73-b3f0ff96e1a9 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:11.096038 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.wsgi [None req-3a985395-6fdf-4edf-af73-b3f0ff96e1a9 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] HTTP exception thrown: Instance cd22650e-6851-4f81-a8d4-e4c7ade26c73 could not be found. Jun 23 22:43:11.097612 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-3a985395-6fdf-4edf-af73-b3f0ff96e1a9 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Request method failure captured: Jun 23 22:43:11.097612 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: request: GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73 HTTP/1.1 Jun 23 22:43:11.097612 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept: application/json Jun 23 22:43:11.097612 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept-Encoding: identity Jun 23 22:43:11.097612 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Connection: close Jun 23 22:43:11.097612 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Length: 0 Jun 23 22:43:11.097612 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Type: application/json Jun 23 22:43:11.097612 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Host: 10.222.0.43 Jun 23 22:43:11.097612 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Openstack-System-Scope: None Jun 23 22:43:11.097612 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: User-Agent: python-urllib3/1.26.9 Jun 23 22:43:11.097612 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Auth-Token: gAAAAABitOrWyDITCi2PmBTdDblZ-ZSwK9B2UK_lIIWOMJB9Z-7YhxsoOI1DrhAeUCIChTCXv2hii5VV1HcTnkYXbW5bgXE95MCdJVwhuPtEsdt8Afqc-N7hZn6zZkza9EI9jSK71KcKdXUQCp4unsH4J6JfPLYATxcY6NVUnHVlcszTDCqSUi0 Jun 23 22:43:11.097612 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Id: None Jun 23 22:43:11.097612 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Name: None Jun 23 22:43:11.097612 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Identity-Status: Confirmed Jun 23 22:43:11.097612 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Is-Admin-Project: True Jun 23 22:43:11.097612 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Id: default Jun 23 22:43:11.097612 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Name: Default Jun 23 22:43:11.097612 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Id: 2735e40fe2564a6d8a5cdc7c32b0b869 Jun 23 22:43:11.097612 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Name: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:43:11.097612 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Role: reader,member Jun 23 22:43:11.097612 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Roles: reader,member Jun 23 22:43:11.099383 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2735e40fe2564a6d8a5cdc7c32b0b869", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2735e40fe2564a6d8a5cdc7c32b0b869"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:43:11.099383 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:43:11.099383 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Id: 2735e40fe2564a6d8a5cdc7c32b0b869 Jun 23 22:43:11.099383 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-184787456 Jun 23 22:43:11.099383 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User: tempest-AttachVolumeNegativeTest-184787456-project Jun 23 22:43:11.099383 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Id: default Jun 23 22:43:11.099383 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Name: Default Jun 23 22:43:11.099383 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Id: 03486c7630314392b85271455d12aba2 Jun 23 22:43:11.099383 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Name: tempest-AttachVolumeNegativeTest-184787456-project Jun 23 22:43:11.099383 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: method: > Jun 23 22:43:11.099383 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: exception: Instance cd22650e-6851-4f81-a8d4-e4c7ade26c73 could not be found. Jun 23 22:43:11.099383 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: action_args: {'id': 'cd22650e-6851-4f81-a8d4-e4c7ade26c73'} Jun 23 22:43:11.100347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:43:11.100347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:43:11.100347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:43:11.100347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:43:11.100347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:43:11.100347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:43:11.100347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:43:11.100347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:43:11.100347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:43:11.100347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:43:11.100347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd22650e-6851-4f81-a8d4-e4c7ade26c73 could not be found. Jun 23 22:43:11.100347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:43:11.100347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:43:11.100347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:43:11.100347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:43:11.100347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:43:11.100347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:43:11.100347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:43:11.100347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:43:11.100347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:43:11.101592 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:43:11.101592 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:43:11.101592 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:43:11.101592 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:43:11.101592 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:43:11.101592 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:43:11.101592 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:43:11.101592 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd22650e-6851-4f81-a8d4-e4c7ade26c73 could not be found. Jun 23 22:43:11.101592 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:43:11.101592 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:43:11.101592 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:43:11.101592 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:43:11.101592 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:43:11.101592 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:43:11.101592 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:43:11.101592 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:43:11.101592 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd22650e-6851-4f81-a8d4-e4c7ade26c73 could not be found. Jun 23 22:43:11.101592 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:43:11.102766 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-3a985395-6fdf-4edf-af73-b3f0ff96e1a9 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] Returning 404 to user: Instance cd22650e-6851-4f81-a8d4-e4c7ade26c73 could not be found. {{(pid=124357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:43:11.102766 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-3a985395-6fdf-4edf-af73-b3f0ff96e1a9 tempest-AttachVolumeNegativeTest-184787456 tempest-AttachVolumeNegativeTest-184787456-project] 10.222.0.43 "GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73" status: 404 len: 111 microversion: 2.1 time: 0.029566 Jun 23 22:43:11.102766 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 387/752] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:43:11 2022] GET /compute/v2.1/servers/cd22650e-6851-4f81-a8d4-e4c7ade26c73 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:43:11.694844 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-16c45fc3-5a89-4f28-9509-da4353d46807 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:43:11.695403 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-16c45fc3-5a89-4f28-9509-da4353d46807 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:11.702087 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-16c45fc3-5a89-4f28-9509-da4353d46807 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:11.702534 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-16c45fc3-5a89-4f28-9509-da4353d46807 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:11.703322 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-16c45fc3-5a89-4f28-9509-da4353d46807 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:11.703794 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-16c45fc3-5a89-4f28-9509-da4353d46807 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:11.726326 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.objects.instance [None req-16c45fc3-5a89-4f28-9509-da4353d46807 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lazy-loading 'flavor' on Instance uuid 7b2f6937-650f-42b2-83cb-f2f54c40a6b3 {{(pid=124358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:43:11.992989 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-16c45fc3-5a89-4f28-9509-da4353d46807 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "POST /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3/action" status: 202 len: 0 microversion: 2.20 time: 0.301832 Jun 23 22:43:11.996529 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 366/753] 10.222.0.43 () {62 vars in 1318 bytes} [Thu Jun 23 22:43:11 2022] POST /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 22:43:12.002334 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-3c341a8f-164e-4f28-9040-eb84f338b5da tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:12.003060 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-3c341a8f-164e-4f28-9040-eb84f338b5da tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:12.009159 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3c341a8f-164e-4f28-9040-eb84f338b5da tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:12.009709 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3c341a8f-164e-4f28-9040-eb84f338b5da tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:12.010538 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3c341a8f-164e-4f28-9040-eb84f338b5da tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:12.011215 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3c341a8f-164e-4f28-9040-eb84f338b5da tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:12.158714 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-3c341a8f-164e-4f28-9040-eb84f338b5da tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:12.170078 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-3c341a8f-164e-4f28-9040-eb84f338b5da tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:12.172021 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-3c341a8f-164e-4f28-9040-eb84f338b5da tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:12.173418 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-3c341a8f-164e-4f28-9040-eb84f338b5da tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1724 microversion: 2.20 time: 0.175065 Jun 23 22:43:12.174278 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 388/754] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:43:11 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:43:13.194506 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-170ed9a3-03ff-4e23-b1fd-3c8d83a543bd tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:13.195536 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-170ed9a3-03ff-4e23-b1fd-3c8d83a543bd tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:13.203199 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-170ed9a3-03ff-4e23-b1fd-3c8d83a543bd tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:13.203944 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-170ed9a3-03ff-4e23-b1fd-3c8d83a543bd tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:13.204846 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-170ed9a3-03ff-4e23-b1fd-3c8d83a543bd tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:13.205410 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-170ed9a3-03ff-4e23-b1fd-3c8d83a543bd tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:13.428074 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-170ed9a3-03ff-4e23-b1fd-3c8d83a543bd tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:13.437686 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-170ed9a3-03ff-4e23-b1fd-3c8d83a543bd tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:13.439215 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-170ed9a3-03ff-4e23-b1fd-3c8d83a543bd tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:13.440373 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-170ed9a3-03ff-4e23-b1fd-3c8d83a543bd tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1724 microversion: 2.20 time: 0.250840 Jun 23 22:43:13.452406 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 367/755] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:43:13 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1724 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:43:14.460243 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-e978a4c2-a9d3-4017-8fde-234fb2ae9cd1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:14.460795 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-e978a4c2-a9d3-4017-8fde-234fb2ae9cd1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:14.467890 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-e978a4c2-a9d3-4017-8fde-234fb2ae9cd1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:14.468347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-e978a4c2-a9d3-4017-8fde-234fb2ae9cd1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:14.469118 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-e978a4c2-a9d3-4017-8fde-234fb2ae9cd1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:14.469562 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-e978a4c2-a9d3-4017-8fde-234fb2ae9cd1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:14.737911 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-e978a4c2-a9d3-4017-8fde-234fb2ae9cd1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:14.745726 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-e978a4c2-a9d3-4017-8fde-234fb2ae9cd1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:14.748586 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-e978a4c2-a9d3-4017-8fde-234fb2ae9cd1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:14.749769 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-e978a4c2-a9d3-4017-8fde-234fb2ae9cd1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1724 microversion: 2.20 time: 0.293575 Jun 23 22:43:14.750677 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 389/756] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:43:14 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1724 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:43:15.770358 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-99ed07a6-d0a7-459d-93a6-8e03296ecb84 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:15.771019 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-99ed07a6-d0a7-459d-93a6-8e03296ecb84 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:15.778554 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-99ed07a6-d0a7-459d-93a6-8e03296ecb84 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:15.779105 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-99ed07a6-d0a7-459d-93a6-8e03296ecb84 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:15.779843 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-99ed07a6-d0a7-459d-93a6-8e03296ecb84 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:15.780272 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-99ed07a6-d0a7-459d-93a6-8e03296ecb84 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:15.917580 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-99ed07a6-d0a7-459d-93a6-8e03296ecb84 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:15.926848 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-99ed07a6-d0a7-459d-93a6-8e03296ecb84 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:15.928417 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-99ed07a6-d0a7-459d-93a6-8e03296ecb84 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:15.929611 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-99ed07a6-d0a7-459d-93a6-8e03296ecb84 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1724 microversion: 2.20 time: 0.163151 Jun 23 22:43:15.930440 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 368/757] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:43:15 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:43:16.950472 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-6eae1683-b03a-4165-a31a-0efb6e8ce635 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:16.951078 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-6eae1683-b03a-4165-a31a-0efb6e8ce635 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:16.957642 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6eae1683-b03a-4165-a31a-0efb6e8ce635 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:16.958087 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6eae1683-b03a-4165-a31a-0efb6e8ce635 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:16.958851 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6eae1683-b03a-4165-a31a-0efb6e8ce635 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:16.959321 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6eae1683-b03a-4165-a31a-0efb6e8ce635 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:17.091982 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-6eae1683-b03a-4165-a31a-0efb6e8ce635 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:17.099872 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-6eae1683-b03a-4165-a31a-0efb6e8ce635 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:17.101391 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-6eae1683-b03a-4165-a31a-0efb6e8ce635 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:17.102544 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-6eae1683-b03a-4165-a31a-0efb6e8ce635 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1724 microversion: 2.20 time: 0.156914 Jun 23 22:43:17.103124 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 390/758] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:43:16 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:43:18.122846 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e90941a1-939d-4cde-8f2d-f1926568e745 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:18.123491 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e90941a1-939d-4cde-8f2d-f1926568e745 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:18.130168 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e90941a1-939d-4cde-8f2d-f1926568e745 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:18.130944 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e90941a1-939d-4cde-8f2d-f1926568e745 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:18.132461 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e90941a1-939d-4cde-8f2d-f1926568e745 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:18.133066 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e90941a1-939d-4cde-8f2d-f1926568e745 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:18.265228 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e90941a1-939d-4cde-8f2d-f1926568e745 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:18.273088 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e90941a1-939d-4cde-8f2d-f1926568e745 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:18.274592 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e90941a1-939d-4cde-8f2d-f1926568e745 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:18.275882 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e90941a1-939d-4cde-8f2d-f1926568e745 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1724 microversion: 2.20 time: 0.158318 Jun 23 22:43:18.276441 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 369/759] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:43:18 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:43:19.295100 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-0e9d603b-8e0f-43a4-b7f8-15c5802b285e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:19.295806 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-0e9d603b-8e0f-43a4-b7f8-15c5802b285e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:19.302374 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-0e9d603b-8e0f-43a4-b7f8-15c5802b285e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:19.303022 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-0e9d603b-8e0f-43a4-b7f8-15c5802b285e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:19.303887 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-0e9d603b-8e0f-43a4-b7f8-15c5802b285e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:19.304395 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-0e9d603b-8e0f-43a4-b7f8-15c5802b285e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:19.441445 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-0e9d603b-8e0f-43a4-b7f8-15c5802b285e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:19.450848 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-0e9d603b-8e0f-43a4-b7f8-15c5802b285e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:19.452633 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-0e9d603b-8e0f-43a4-b7f8-15c5802b285e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:19.453802 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-0e9d603b-8e0f-43a4-b7f8-15c5802b285e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1724 microversion: 2.20 time: 0.162971 Jun 23 22:43:19.454351 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 391/760] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:43:19 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:43:20.472238 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-ceeba1d9-1c07-4278-8bc0-b8efc470eec7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:20.472906 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-ceeba1d9-1c07-4278-8bc0-b8efc470eec7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:20.479661 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ceeba1d9-1c07-4278-8bc0-b8efc470eec7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:20.480109 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ceeba1d9-1c07-4278-8bc0-b8efc470eec7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:20.481941 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ceeba1d9-1c07-4278-8bc0-b8efc470eec7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:20.482376 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ceeba1d9-1c07-4278-8bc0-b8efc470eec7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:20.485152 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:43:20.612006 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ceeba1d9-1c07-4278-8bc0-b8efc470eec7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:20.619962 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ceeba1d9-1c07-4278-8bc0-b8efc470eec7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:20.622342 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ceeba1d9-1c07-4278-8bc0-b8efc470eec7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:20.623531 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-ceeba1d9-1c07-4278-8bc0-b8efc470eec7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1724 microversion: 2.20 time: 0.155293 Jun 23 22:43:20.624086 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 370/761] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:43:20 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:43:21.642137 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-69edfb26-0033-445e-8194-a4b9e8a7d538 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:21.642749 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-69edfb26-0033-445e-8194-a4b9e8a7d538 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:21.649312 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-69edfb26-0033-445e-8194-a4b9e8a7d538 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:21.649759 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-69edfb26-0033-445e-8194-a4b9e8a7d538 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:21.650516 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-69edfb26-0033-445e-8194-a4b9e8a7d538 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:21.650975 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-69edfb26-0033-445e-8194-a4b9e8a7d538 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:21.780564 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-69edfb26-0033-445e-8194-a4b9e8a7d538 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:21.788404 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-69edfb26-0033-445e-8194-a4b9e8a7d538 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:21.789922 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-69edfb26-0033-445e-8194-a4b9e8a7d538 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:21.791354 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-69edfb26-0033-445e-8194-a4b9e8a7d538 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1724 microversion: 2.20 time: 0.152906 Jun 23 22:43:21.791908 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 392/762] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:43:21 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:43:22.809429 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-5a60dd5b-b358-4db9-9d78-7ec9fd2d8ac2 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:22.810044 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-5a60dd5b-b358-4db9-9d78-7ec9fd2d8ac2 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:22.817089 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5a60dd5b-b358-4db9-9d78-7ec9fd2d8ac2 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:22.817530 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5a60dd5b-b358-4db9-9d78-7ec9fd2d8ac2 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:22.818286 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5a60dd5b-b358-4db9-9d78-7ec9fd2d8ac2 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:22.818711 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5a60dd5b-b358-4db9-9d78-7ec9fd2d8ac2 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:22.948395 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-5a60dd5b-b358-4db9-9d78-7ec9fd2d8ac2 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:22.956897 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-5a60dd5b-b358-4db9-9d78-7ec9fd2d8ac2 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:22.958860 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-5a60dd5b-b358-4db9-9d78-7ec9fd2d8ac2 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:22.959739 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-5a60dd5b-b358-4db9-9d78-7ec9fd2d8ac2 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1724 microversion: 2.20 time: 0.154383 Jun 23 22:43:22.960296 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 371/763] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:43:22 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:43:23.977761 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-1ccb9ee7-9eb1-4efb-af8b-0ec9567e4ac1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:23.978422 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-1ccb9ee7-9eb1-4efb-af8b-0ec9567e4ac1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:23.985842 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1ccb9ee7-9eb1-4efb-af8b-0ec9567e4ac1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:23.986469 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1ccb9ee7-9eb1-4efb-af8b-0ec9567e4ac1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:23.987261 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1ccb9ee7-9eb1-4efb-af8b-0ec9567e4ac1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:23.987692 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1ccb9ee7-9eb1-4efb-af8b-0ec9567e4ac1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:24.126527 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-1ccb9ee7-9eb1-4efb-af8b-0ec9567e4ac1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:24.134430 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-1ccb9ee7-9eb1-4efb-af8b-0ec9567e4ac1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:24.136001 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-1ccb9ee7-9eb1-4efb-af8b-0ec9567e4ac1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:24.137244 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-1ccb9ee7-9eb1-4efb-af8b-0ec9567e4ac1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1724 microversion: 2.20 time: 0.163697 Jun 23 22:43:24.137792 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 393/764] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:43:23 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:43:25.157228 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-3e861e4a-f12d-4b53-b41f-32811b65075a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:25.157845 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-3e861e4a-f12d-4b53-b41f-32811b65075a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:25.164303 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3e861e4a-f12d-4b53-b41f-32811b65075a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:25.164753 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3e861e4a-f12d-4b53-b41f-32811b65075a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:25.165517 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3e861e4a-f12d-4b53-b41f-32811b65075a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:25.165948 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3e861e4a-f12d-4b53-b41f-32811b65075a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:25.303091 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-3e861e4a-f12d-4b53-b41f-32811b65075a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:25.311295 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-3e861e4a-f12d-4b53-b41f-32811b65075a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:25.312794 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-3e861e4a-f12d-4b53-b41f-32811b65075a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:25.314006 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-3e861e4a-f12d-4b53-b41f-32811b65075a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1724 microversion: 2.20 time: 0.160621 Jun 23 22:43:25.314567 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 372/765] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:43:25 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:43:26.333209 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-1768bfc9-b822-415d-89bb-6edb6de65c6b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:26.333925 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-1768bfc9-b822-415d-89bb-6edb6de65c6b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:26.344982 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1768bfc9-b822-415d-89bb-6edb6de65c6b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:26.345428 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1768bfc9-b822-415d-89bb-6edb6de65c6b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:26.346201 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1768bfc9-b822-415d-89bb-6edb6de65c6b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:26.346637 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1768bfc9-b822-415d-89bb-6edb6de65c6b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:26.483527 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-1768bfc9-b822-415d-89bb-6edb6de65c6b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:26.492836 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-1768bfc9-b822-415d-89bb-6edb6de65c6b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:26.494344 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-1768bfc9-b822-415d-89bb-6edb6de65c6b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:26.495533 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-1768bfc9-b822-415d-89bb-6edb6de65c6b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1724 microversion: 2.20 time: 0.166820 Jun 23 22:43:26.496136 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 394/766] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:43:26 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:43:27.513808 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-1b6e4a78-2fe6-4440-abed-d0f2caf201f7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:27.514488 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-1b6e4a78-2fe6-4440-abed-d0f2caf201f7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:27.516581 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:43:27.522623 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1b6e4a78-2fe6-4440-abed-d0f2caf201f7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:27.523110 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1b6e4a78-2fe6-4440-abed-d0f2caf201f7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:27.523872 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1b6e4a78-2fe6-4440-abed-d0f2caf201f7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:27.524300 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1b6e4a78-2fe6-4440-abed-d0f2caf201f7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:27.662631 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-1b6e4a78-2fe6-4440-abed-d0f2caf201f7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:27.672091 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-1b6e4a78-2fe6-4440-abed-d0f2caf201f7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:27.673575 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-1b6e4a78-2fe6-4440-abed-d0f2caf201f7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:27.674726 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-1b6e4a78-2fe6-4440-abed-d0f2caf201f7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1724 microversion: 2.20 time: 0.164995 Jun 23 22:43:27.675323 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 373/767] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:43:27 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:43:28.692920 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-9b6e036b-208b-4e95-bb05-9e2c723f039a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:28.693846 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-9b6e036b-208b-4e95-bb05-9e2c723f039a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:28.702042 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9b6e036b-208b-4e95-bb05-9e2c723f039a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:28.702423 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9b6e036b-208b-4e95-bb05-9e2c723f039a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:28.703248 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9b6e036b-208b-4e95-bb05-9e2c723f039a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:28.703650 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9b6e036b-208b-4e95-bb05-9e2c723f039a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:28.836693 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-9b6e036b-208b-4e95-bb05-9e2c723f039a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:28.846235 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-9b6e036b-208b-4e95-bb05-9e2c723f039a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:28.847778 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-9b6e036b-208b-4e95-bb05-9e2c723f039a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:28.848931 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-9b6e036b-208b-4e95-bb05-9e2c723f039a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1724 microversion: 2.20 time: 0.160424 Jun 23 22:43:28.849485 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 395/768] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:43:28 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:43:29.868349 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-7352bd4a-f8bb-4444-ad68-7fd8333a5492 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:29.868946 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-7352bd4a-f8bb-4444-ad68-7fd8333a5492 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:29.875951 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7352bd4a-f8bb-4444-ad68-7fd8333a5492 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:29.876396 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7352bd4a-f8bb-4444-ad68-7fd8333a5492 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:29.877151 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7352bd4a-f8bb-4444-ad68-7fd8333a5492 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:29.877580 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7352bd4a-f8bb-4444-ad68-7fd8333a5492 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:30.004690 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-7352bd4a-f8bb-4444-ad68-7fd8333a5492 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:30.012598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-7352bd4a-f8bb-4444-ad68-7fd8333a5492 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:30.014117 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-7352bd4a-f8bb-4444-ad68-7fd8333a5492 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:30.015323 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-7352bd4a-f8bb-4444-ad68-7fd8333a5492 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1724 microversion: 2.20 time: 0.150851 Jun 23 22:43:30.015875 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 374/769] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:43:29 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:43:31.033920 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-7013dbee-3edc-4a06-8f5f-a80b5c097955 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:31.034526 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-7013dbee-3edc-4a06-8f5f-a80b5c097955 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:31.036988 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:43:31.042502 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7013dbee-3edc-4a06-8f5f-a80b5c097955 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:31.042965 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7013dbee-3edc-4a06-8f5f-a80b5c097955 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:31.043760 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7013dbee-3edc-4a06-8f5f-a80b5c097955 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:31.044191 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7013dbee-3edc-4a06-8f5f-a80b5c097955 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:31.175561 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-7013dbee-3edc-4a06-8f5f-a80b5c097955 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:31.183450 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-7013dbee-3edc-4a06-8f5f-a80b5c097955 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:31.185746 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-7013dbee-3edc-4a06-8f5f-a80b5c097955 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:31.186965 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-7013dbee-3edc-4a06-8f5f-a80b5c097955 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1724 microversion: 2.20 time: 0.156977 Jun 23 22:43:31.187538 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 396/770] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:43:31 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:43:32.205323 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-5c0a03ba-0f08-46c3-b6e1-88e523319af9 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:32.205949 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-5c0a03ba-0f08-46c3-b6e1-88e523319af9 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:32.212491 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5c0a03ba-0f08-46c3-b6e1-88e523319af9 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:32.212942 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5c0a03ba-0f08-46c3-b6e1-88e523319af9 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:32.213711 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5c0a03ba-0f08-46c3-b6e1-88e523319af9 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:32.214147 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5c0a03ba-0f08-46c3-b6e1-88e523319af9 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:32.343014 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-5c0a03ba-0f08-46c3-b6e1-88e523319af9 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:32.350877 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-5c0a03ba-0f08-46c3-b6e1-88e523319af9 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:32.352445 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-5c0a03ba-0f08-46c3-b6e1-88e523319af9 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:32.353580 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-5c0a03ba-0f08-46c3-b6e1-88e523319af9 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1724 microversion: 2.20 time: 0.152213 Jun 23 22:43:32.354131 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 375/771] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:43:32 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:43:33.371856 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-640b599a-6621-4551-972b-b7e7ce0de91f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:33.373083 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-640b599a-6621-4551-972b-b7e7ce0de91f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:33.379538 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-640b599a-6621-4551-972b-b7e7ce0de91f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:33.379980 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-640b599a-6621-4551-972b-b7e7ce0de91f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:33.380724 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-640b599a-6621-4551-972b-b7e7ce0de91f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:33.381170 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-640b599a-6621-4551-972b-b7e7ce0de91f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:33.383692 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:43:33.515231 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-640b599a-6621-4551-972b-b7e7ce0de91f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:33.523108 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-640b599a-6621-4551-972b-b7e7ce0de91f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:33.524603 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-640b599a-6621-4551-972b-b7e7ce0de91f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:33.525749 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-640b599a-6621-4551-972b-b7e7ce0de91f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1724 microversion: 2.20 time: 0.157918 Jun 23 22:43:33.526308 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 397/772] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:43:33 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:43:34.545287 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-9a6b6978-3e14-49b7-8c3f-61c4a133bbe3 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:34.545902 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-9a6b6978-3e14-49b7-8c3f-61c4a133bbe3 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:34.552380 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9a6b6978-3e14-49b7-8c3f-61c4a133bbe3 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:34.552823 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9a6b6978-3e14-49b7-8c3f-61c4a133bbe3 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:34.553579 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9a6b6978-3e14-49b7-8c3f-61c4a133bbe3 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:34.554010 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9a6b6978-3e14-49b7-8c3f-61c4a133bbe3 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:34.680985 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-9a6b6978-3e14-49b7-8c3f-61c4a133bbe3 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:34.689130 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-9a6b6978-3e14-49b7-8c3f-61c4a133bbe3 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:34.690622 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-9a6b6978-3e14-49b7-8c3f-61c4a133bbe3 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:34.691806 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-9a6b6978-3e14-49b7-8c3f-61c4a133bbe3 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1724 microversion: 2.20 time: 0.151210 Jun 23 22:43:34.692362 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 376/773] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:43:34 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:43:35.710664 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-db1c07d9-445e-4b28-a613-d4b2fd70540c tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:35.711298 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-db1c07d9-445e-4b28-a613-d4b2fd70540c tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:35.718611 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-db1c07d9-445e-4b28-a613-d4b2fd70540c tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:35.718749 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-db1c07d9-445e-4b28-a613-d4b2fd70540c tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:35.719527 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-db1c07d9-445e-4b28-a613-d4b2fd70540c tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:35.719957 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-db1c07d9-445e-4b28-a613-d4b2fd70540c tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:35.852485 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-db1c07d9-445e-4b28-a613-d4b2fd70540c tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:35.861119 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-db1c07d9-445e-4b28-a613-d4b2fd70540c tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:35.862624 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-db1c07d9-445e-4b28-a613-d4b2fd70540c tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:35.863824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-db1c07d9-445e-4b28-a613-d4b2fd70540c tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1745 microversion: 2.20 time: 0.157012 Jun 23 22:43:35.864381 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 398/774] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:43:35 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:43:36.883190 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-abdfea57-7a16-409f-9e6d-0a70f89f9140 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:36.883888 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-abdfea57-7a16-409f-9e6d-0a70f89f9140 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:36.890502 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-abdfea57-7a16-409f-9e6d-0a70f89f9140 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:36.890965 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-abdfea57-7a16-409f-9e6d-0a70f89f9140 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:36.891726 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-abdfea57-7a16-409f-9e6d-0a70f89f9140 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:36.892151 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-abdfea57-7a16-409f-9e6d-0a70f89f9140 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:37.025987 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-abdfea57-7a16-409f-9e6d-0a70f89f9140 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:37.033905 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-abdfea57-7a16-409f-9e6d-0a70f89f9140 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:37.035418 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-abdfea57-7a16-409f-9e6d-0a70f89f9140 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:37.036563 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-abdfea57-7a16-409f-9e6d-0a70f89f9140 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1745 microversion: 2.20 time: 0.157300 Jun 23 22:43:37.037117 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 377/775] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:43:36 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:43:38.055716 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-c2d60e59-c017-4ad7-b2bc-542c7f45afbf tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:38.056505 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-c2d60e59-c017-4ad7-b2bc-542c7f45afbf tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:38.067642 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c2d60e59-c017-4ad7-b2bc-542c7f45afbf tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:38.068714 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c2d60e59-c017-4ad7-b2bc-542c7f45afbf tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:38.070009 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c2d60e59-c017-4ad7-b2bc-542c7f45afbf tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:38.070443 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c2d60e59-c017-4ad7-b2bc-542c7f45afbf tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:38.277008 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-c2d60e59-c017-4ad7-b2bc-542c7f45afbf tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:38.297678 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-c2d60e59-c017-4ad7-b2bc-542c7f45afbf tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:38.299430 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-c2d60e59-c017-4ad7-b2bc-542c7f45afbf tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:38.300936 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-c2d60e59-c017-4ad7-b2bc-542c7f45afbf tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1740 microversion: 2.20 time: 0.248844 Jun 23 22:43:38.306972 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 399/776] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:43:38 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1740 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:43:38.364764 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-37e8534d-2683-4f65-9e34-29663e2503ea req-657b3265-119b-4502-b1c7-26325728894e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b2f6937-650f-42b2-83cb-f2f54c40a6b3", "name": "network-vif-plugged", "status": "completed", "tag": "25e676fe-9948-4de4-91ae-b15fb391a86c"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:43:38.378788 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-37e8534d-2683-4f65-9e34-29663e2503ea req-657b3265-119b-4502-b1c7-26325728894e service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:38.379849 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-37e8534d-2683-4f65-9e34-29663e2503ea req-657b3265-119b-4502-b1c7-26325728894e service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:38.410073 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-37e8534d-2683-4f65-9e34-29663e2503ea req-657b3265-119b-4502-b1c7-26325728894e service nova] Creating event network-vif-plugged:25e676fe-9948-4de4-91ae-b15fb391a86c for instance 7b2f6937-650f-42b2-83cb-f2f54c40a6b3 on hv-cinder-84617 Jun 23 22:43:38.422456 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-37e8534d-2683-4f65-9e34-29663e2503ea req-657b3265-119b-4502-b1c7-26325728894e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060979 Jun 23 22:43:38.426625 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 378/777] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:43:39.321111 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-b1a9fc29-36ec-41f5-8c65-dd7ca631da91 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:39.322529 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-b1a9fc29-36ec-41f5-8c65-dd7ca631da91 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:39.330325 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-b1a9fc29-36ec-41f5-8c65-dd7ca631da91 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:39.331153 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-b1a9fc29-36ec-41f5-8c65-dd7ca631da91 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:39.332211 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-b1a9fc29-36ec-41f5-8c65-dd7ca631da91 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:39.332717 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-b1a9fc29-36ec-41f5-8c65-dd7ca631da91 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:39.509226 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-b1a9fc29-36ec-41f5-8c65-dd7ca631da91 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:39.520507 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-b1a9fc29-36ec-41f5-8c65-dd7ca631da91 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:39.522126 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-b1a9fc29-36ec-41f5-8c65-dd7ca631da91 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:39.523366 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-b1a9fc29-36ec-41f5-8c65-dd7ca631da91 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1740 microversion: 2.20 time: 0.206536 Jun 23 22:43:39.524426 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 400/778] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:43:39 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1740 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:43:40.544550 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-89466d8c-70e1-423e-9dcf-3c5c54fddb93 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:40.545281 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-89466d8c-70e1-423e-9dcf-3c5c54fddb93 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:40.558250 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-89466d8c-70e1-423e-9dcf-3c5c54fddb93 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:40.558705 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-89466d8c-70e1-423e-9dcf-3c5c54fddb93 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:40.559778 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-89466d8c-70e1-423e-9dcf-3c5c54fddb93 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:40.560733 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-89466d8c-70e1-423e-9dcf-3c5c54fddb93 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:40.741587 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-89466d8c-70e1-423e-9dcf-3c5c54fddb93 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:40.751245 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-89466d8c-70e1-423e-9dcf-3c5c54fddb93 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:40.752768 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-89466d8c-70e1-423e-9dcf-3c5c54fddb93 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:40.753964 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-89466d8c-70e1-423e-9dcf-3c5c54fddb93 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1740 microversion: 2.20 time: 0.214416 Jun 23 22:43:40.754749 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 379/779] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:43:40 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1740 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:43:41.776960 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-c242118e-2701-4f88-816b-4c7bec6b5e35 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:41.778298 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-c242118e-2701-4f88-816b-4c7bec6b5e35 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:41.787612 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c242118e-2701-4f88-816b-4c7bec6b5e35 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:41.792234 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c242118e-2701-4f88-816b-4c7bec6b5e35 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:41.794251 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c242118e-2701-4f88-816b-4c7bec6b5e35 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:41.795067 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c242118e-2701-4f88-816b-4c7bec6b5e35 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:41.980230 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-c242118e-2701-4f88-816b-4c7bec6b5e35 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:41.989525 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-c242118e-2701-4f88-816b-4c7bec6b5e35 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:41.992282 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-c242118e-2701-4f88-816b-4c7bec6b5e35 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:41.994323 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-c242118e-2701-4f88-816b-4c7bec6b5e35 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1740 microversion: 2.20 time: 0.221185 Jun 23 22:43:41.994894 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 401/780] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:43:41 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1740 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:43:43.014057 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d1bb07cc-4048-482d-aaa8-32c5a58c22aa tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:43.015395 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-d1bb07cc-4048-482d-aaa8-32c5a58c22aa tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:43.022560 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d1bb07cc-4048-482d-aaa8-32c5a58c22aa tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:43.023027 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d1bb07cc-4048-482d-aaa8-32c5a58c22aa tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:43.023795 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d1bb07cc-4048-482d-aaa8-32c5a58c22aa tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:43.024228 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d1bb07cc-4048-482d-aaa8-32c5a58c22aa tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:43.183847 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d1bb07cc-4048-482d-aaa8-32c5a58c22aa tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:43.192644 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d1bb07cc-4048-482d-aaa8-32c5a58c22aa tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:43.194468 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d1bb07cc-4048-482d-aaa8-32c5a58c22aa tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:43.195671 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d1bb07cc-4048-482d-aaa8-32c5a58c22aa tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1740 microversion: 2.20 time: 0.185919 Jun 23 22:43:43.196735 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 380/781] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:43:43 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:43:44.216332 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-65a2758d-c74c-491a-ae14-5f79e3560c17 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:44.217820 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-65a2758d-c74c-491a-ae14-5f79e3560c17 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:44.224500 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-65a2758d-c74c-491a-ae14-5f79e3560c17 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:44.224941 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-65a2758d-c74c-491a-ae14-5f79e3560c17 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:44.225880 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-65a2758d-c74c-491a-ae14-5f79e3560c17 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:44.226301 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-65a2758d-c74c-491a-ae14-5f79e3560c17 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:44.383331 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-65a2758d-c74c-491a-ae14-5f79e3560c17 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:44.395928 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-65a2758d-c74c-491a-ae14-5f79e3560c17 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:44.397924 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-65a2758d-c74c-491a-ae14-5f79e3560c17 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:44.399205 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-65a2758d-c74c-491a-ae14-5f79e3560c17 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1740 microversion: 2.20 time: 0.187400 Jun 23 22:43:44.400509 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 402/782] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:43:44 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:43:45.428587 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-6bc2e550-f4b3-4cc2-b730-edf4fc19004a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:45.429165 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-6bc2e550-f4b3-4cc2-b730-edf4fc19004a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:45.436855 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6bc2e550-f4b3-4cc2-b730-edf4fc19004a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:45.437501 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6bc2e550-f4b3-4cc2-b730-edf4fc19004a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:45.438477 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6bc2e550-f4b3-4cc2-b730-edf4fc19004a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:45.438914 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6bc2e550-f4b3-4cc2-b730-edf4fc19004a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:45.617073 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-6bc2e550-f4b3-4cc2-b730-edf4fc19004a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:45.626004 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-6bc2e550-f4b3-4cc2-b730-edf4fc19004a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:45.635343 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-6bc2e550-f4b3-4cc2-b730-edf4fc19004a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:45.637637 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-6bc2e550-f4b3-4cc2-b730-edf4fc19004a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1740 microversion: 2.20 time: 0.213460 Jun 23 22:43:45.649431 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 381/783] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:43:45 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1740 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:43:46.656424 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-a0300a2b-08a6-40dd-b182-dc4afef43999 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:46.657038 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-a0300a2b-08a6-40dd-b182-dc4afef43999 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:46.668165 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a0300a2b-08a6-40dd-b182-dc4afef43999 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:46.670278 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a0300a2b-08a6-40dd-b182-dc4afef43999 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:46.671317 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a0300a2b-08a6-40dd-b182-dc4afef43999 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:46.671935 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a0300a2b-08a6-40dd-b182-dc4afef43999 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:46.840555 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-a0300a2b-08a6-40dd-b182-dc4afef43999 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:46.852854 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-a0300a2b-08a6-40dd-b182-dc4afef43999 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:46.854861 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-a0300a2b-08a6-40dd-b182-dc4afef43999 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:46.856237 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-a0300a2b-08a6-40dd-b182-dc4afef43999 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1740 microversion: 2.20 time: 0.203930 Jun 23 22:43:46.857948 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 403/784] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:43:46 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1740 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:43:47.875867 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-dc10c056-8560-4614-8e24-30d4774791fb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:47.876487 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-dc10c056-8560-4614-8e24-30d4774791fb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:47.882853 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-dc10c056-8560-4614-8e24-30d4774791fb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:47.883316 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-dc10c056-8560-4614-8e24-30d4774791fb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:47.884237 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-dc10c056-8560-4614-8e24-30d4774791fb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:47.884658 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-dc10c056-8560-4614-8e24-30d4774791fb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:48.101320 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-dc10c056-8560-4614-8e24-30d4774791fb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:48.109414 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-dc10c056-8560-4614-8e24-30d4774791fb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:48.110910 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-dc10c056-8560-4614-8e24-30d4774791fb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:48.112087 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-dc10c056-8560-4614-8e24-30d4774791fb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1722 microversion: 2.20 time: 0.241319 Jun 23 22:43:48.112645 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 382/785] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:43:47 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:43:49.130933 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-382f51ff-78c0-4dfb-8fa2-d31b12da06b4 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:49.131564 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-382f51ff-78c0-4dfb-8fa2-d31b12da06b4 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:49.138040 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-382f51ff-78c0-4dfb-8fa2-d31b12da06b4 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:49.138481 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-382f51ff-78c0-4dfb-8fa2-d31b12da06b4 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:49.139314 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-382f51ff-78c0-4dfb-8fa2-d31b12da06b4 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:49.139772 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-382f51ff-78c0-4dfb-8fa2-d31b12da06b4 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:49.287123 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-382f51ff-78c0-4dfb-8fa2-d31b12da06b4 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:49.295946 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-382f51ff-78c0-4dfb-8fa2-d31b12da06b4 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:49.297436 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-382f51ff-78c0-4dfb-8fa2-d31b12da06b4 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:49.298577 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-382f51ff-78c0-4dfb-8fa2-d31b12da06b4 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1722 microversion: 2.20 time: 0.171584 Jun 23 22:43:49.299170 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 404/786] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:43:49 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:43:50.317099 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c71ee529-16a6-4394-b457-6445b2a25257 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:50.317759 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c71ee529-16a6-4394-b457-6445b2a25257 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:50.324377 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c71ee529-16a6-4394-b457-6445b2a25257 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:50.324820 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c71ee529-16a6-4394-b457-6445b2a25257 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:50.325617 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c71ee529-16a6-4394-b457-6445b2a25257 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:50.326046 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c71ee529-16a6-4394-b457-6445b2a25257 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:50.453213 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c71ee529-16a6-4394-b457-6445b2a25257 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:50.461546 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c71ee529-16a6-4394-b457-6445b2a25257 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:50.463236 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c71ee529-16a6-4394-b457-6445b2a25257 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:50.465121 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c71ee529-16a6-4394-b457-6445b2a25257 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1725 microversion: 2.20 time: 0.151864 Jun 23 22:43:50.466115 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 383/787] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:43:50 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:43:50.483975 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-891e4313-b423-477f-b341-f537d5310e1a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f02a5d89-9ed2-4014-a0ce-f605496399ce"}} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:43:50.485775 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-891e4313-b423-477f-b341-f537d5310e1a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:50.492931 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-891e4313-b423-477f-b341-f537d5310e1a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:50.493396 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-891e4313-b423-477f-b341-f537d5310e1a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:50.494157 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-891e4313-b423-477f-b341-f537d5310e1a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:50.494586 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-891e4313-b423-477f-b341-f537d5310e1a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:50.797458 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-891e4313-b423-477f-b341-f537d5310e1a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "POST /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.317958 Jun 23 22:43:50.798105 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 405/788] 10.222.0.43 () {62 vars in 1363 bytes} [Thu Jun 23 22:43:50 2022] POST /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3/os-volume_attachments => generated 188 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 22:43:50.913601 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-7449cc17-686c-4d95-afe1-b86e47fdfb32 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:43:50.914192 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-7449cc17-686c-4d95-afe1-b86e47fdfb32 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:50.921592 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7449cc17-686c-4d95-afe1-b86e47fdfb32 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:50.922043 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7449cc17-686c-4d95-afe1-b86e47fdfb32 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:50.922803 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7449cc17-686c-4d95-afe1-b86e47fdfb32 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:50.923260 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7449cc17-686c-4d95-afe1-b86e47fdfb32 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:50.926892 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=80 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:43:51.014011 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-7449cc17-686c-4d95-afe1-b86e47fdfb32 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "POST /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3/action" status: 202 len: 0 microversion: 2.20 time: 0.104249 Jun 23 22:43:51.014612 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 384/789] 10.222.0.43 () {62 vars in 1318 bytes} [Thu Jun 23 22:43:50 2022] POST /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 22:43:51.022495 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-6100d3b2-69ed-4b08-9ba8-139d578f7002 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:51.023128 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-6100d3b2-69ed-4b08-9ba8-139d578f7002 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:51.032466 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6100d3b2-69ed-4b08-9ba8-139d578f7002 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:51.033418 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6100d3b2-69ed-4b08-9ba8-139d578f7002 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:51.034188 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6100d3b2-69ed-4b08-9ba8-139d578f7002 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:51.034615 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6100d3b2-69ed-4b08-9ba8-139d578f7002 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:51.165035 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-6100d3b2-69ed-4b08-9ba8-139d578f7002 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:51.174895 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-6100d3b2-69ed-4b08-9ba8-139d578f7002 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:51.176427 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-6100d3b2-69ed-4b08-9ba8-139d578f7002 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:51.177592 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-6100d3b2-69ed-4b08-9ba8-139d578f7002 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1751 microversion: 2.20 time: 0.158939 Jun 23 22:43:51.178137 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 406/790] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:43:51 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:43:52.196804 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b13caf3c-11d1-464b-9be8-2d6d127bca48 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:52.197427 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-b13caf3c-11d1-464b-9be8-2d6d127bca48 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:52.205620 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b13caf3c-11d1-464b-9be8-2d6d127bca48 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:52.206072 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b13caf3c-11d1-464b-9be8-2d6d127bca48 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:52.206853 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b13caf3c-11d1-464b-9be8-2d6d127bca48 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:52.207547 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b13caf3c-11d1-464b-9be8-2d6d127bca48 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:52.318995 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [req-4a93b7f3-56d2-403f-b4f7-06f965bd2e1b req-3204333d-a6d4-4d0b-8d1d-0d7ef9e745a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b2f6937-650f-42b2-83cb-f2f54c40a6b3", "name": "network-vif-unplugged", "status": "completed", "tag": "25e676fe-9948-4de4-91ae-b15fb391a86c"}]} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:43:52.327991 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-4a93b7f3-56d2-403f-b4f7-06f965bd2e1b req-3204333d-a6d4-4d0b-8d1d-0d7ef9e745a4 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:52.328654 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-4a93b7f3-56d2-403f-b4f7-06f965bd2e1b req-3204333d-a6d4-4d0b-8d1d-0d7ef9e745a4 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:52.342770 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.compute.server_external_events [req-4a93b7f3-56d2-403f-b4f7-06f965bd2e1b req-3204333d-a6d4-4d0b-8d1d-0d7ef9e745a4 service nova] Unable to find a host for instance 7b2f6937-650f-42b2-83cb-f2f54c40a6b3. Dropping event network-vif-unplugged {{(pid=124357) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 23 22:43:52.344829 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [req-4a93b7f3-56d2-403f-b4f7-06f965bd2e1b req-3204333d-a6d4-4d0b-8d1d-0d7ef9e745a4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029596 Jun 23 22:43:52.345620 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 407/791] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 23 22:43:52.349005 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b13caf3c-11d1-464b-9be8-2d6d127bca48 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:52.358390 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b13caf3c-11d1-464b-9be8-2d6d127bca48 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:52.359935 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b13caf3c-11d1-464b-9be8-2d6d127bca48 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:52.361145 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-b13caf3c-11d1-464b-9be8-2d6d127bca48 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1753 microversion: 2.20 time: 0.168797 Jun 23 22:43:52.361690 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 385/792] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:43:52 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:43:53.386492 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-8c5b966e-e119-46b3-babe-fef44391ffc1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:53.387228 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-8c5b966e-e119-46b3-babe-fef44391ffc1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:53.398887 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-8c5b966e-e119-46b3-babe-fef44391ffc1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:53.399364 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-8c5b966e-e119-46b3-babe-fef44391ffc1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:53.401077 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-8c5b966e-e119-46b3-babe-fef44391ffc1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:53.401517 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-8c5b966e-e119-46b3-babe-fef44391ffc1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:53.621773 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-8c5b966e-e119-46b3-babe-fef44391ffc1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:53.630304 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-8c5b966e-e119-46b3-babe-fef44391ffc1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:53.631881 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-8c5b966e-e119-46b3-babe-fef44391ffc1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:53.633037 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-8c5b966e-e119-46b3-babe-fef44391ffc1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1809 microversion: 2.20 time: 0.255983 Jun 23 22:43:53.633591 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 408/793] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:43:53 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1809 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:43:54.652538 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-353477c6-de13-4db3-94a3-635f56d302eb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:54.653918 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-353477c6-de13-4db3-94a3-635f56d302eb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:54.665905 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-353477c6-de13-4db3-94a3-635f56d302eb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:54.666641 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-353477c6-de13-4db3-94a3-635f56d302eb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:54.667895 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-353477c6-de13-4db3-94a3-635f56d302eb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:54.668754 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-353477c6-de13-4db3-94a3-635f56d302eb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:54.839890 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-353477c6-de13-4db3-94a3-635f56d302eb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:54.851275 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-353477c6-de13-4db3-94a3-635f56d302eb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:54.868269 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-353477c6-de13-4db3-94a3-635f56d302eb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:54.871126 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-353477c6-de13-4db3-94a3-635f56d302eb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1809 microversion: 2.20 time: 0.222652 Jun 23 22:43:54.891201 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 386/794] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:43:54 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1809 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:43:55.897614 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-0147f55a-51cf-4473-b49a-5fbb9d31af3f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:55.898241 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-0147f55a-51cf-4473-b49a-5fbb9d31af3f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:55.905848 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-0147f55a-51cf-4473-b49a-5fbb9d31af3f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:55.906294 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-0147f55a-51cf-4473-b49a-5fbb9d31af3f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:55.907102 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-0147f55a-51cf-4473-b49a-5fbb9d31af3f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:55.907720 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-0147f55a-51cf-4473-b49a-5fbb9d31af3f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:56.078122 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-0147f55a-51cf-4473-b49a-5fbb9d31af3f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:56.087819 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-0147f55a-51cf-4473-b49a-5fbb9d31af3f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:56.093291 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-0147f55a-51cf-4473-b49a-5fbb9d31af3f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:56.100113 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-0147f55a-51cf-4473-b49a-5fbb9d31af3f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1809 microversion: 2.20 time: 0.201284 Jun 23 22:43:56.100966 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 409/795] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:43:55 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1809 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:43:57.120646 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c2953149-d86d-45b6-9316-bfaffaf9875a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:57.131203 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c2953149-d86d-45b6-9316-bfaffaf9875a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:57.143210 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c2953149-d86d-45b6-9316-bfaffaf9875a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:57.143940 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c2953149-d86d-45b6-9316-bfaffaf9875a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:57.146710 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c2953149-d86d-45b6-9316-bfaffaf9875a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:57.147610 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c2953149-d86d-45b6-9316-bfaffaf9875a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:57.366967 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c2953149-d86d-45b6-9316-bfaffaf9875a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:57.376441 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c2953149-d86d-45b6-9316-bfaffaf9875a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:57.377857 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c2953149-d86d-45b6-9316-bfaffaf9875a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:57.379049 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c2953149-d86d-45b6-9316-bfaffaf9875a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1809 microversion: 2.20 time: 0.262779 Jun 23 22:43:57.379611 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 387/796] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:43:57 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1809 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:43:58.401901 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-9d6d2718-b79d-478c-ae85-53ebef37c2a7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:58.403927 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-9d6d2718-b79d-478c-ae85-53ebef37c2a7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:58.411424 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9d6d2718-b79d-478c-ae85-53ebef37c2a7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:58.411949 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9d6d2718-b79d-478c-ae85-53ebef37c2a7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:58.412860 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9d6d2718-b79d-478c-ae85-53ebef37c2a7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:58.413369 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9d6d2718-b79d-478c-ae85-53ebef37c2a7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:58.562441 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-9d6d2718-b79d-478c-ae85-53ebef37c2a7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:58.577113 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-9d6d2718-b79d-478c-ae85-53ebef37c2a7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:58.579253 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-9d6d2718-b79d-478c-ae85-53ebef37c2a7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:58.580742 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-9d6d2718-b79d-478c-ae85-53ebef37c2a7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1809 microversion: 2.20 time: 0.182760 Jun 23 22:43:58.591893 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 410/797] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:43:58 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:43:59.602258 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-1771ec13-11df-4ee1-a852-26761a05e198 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:59.605250 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-1771ec13-11df-4ee1-a852-26761a05e198 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:43:59.606646 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=32 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:43:59.610423 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1771ec13-11df-4ee1-a852-26761a05e198 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:59.611164 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1771ec13-11df-4ee1-a852-26761a05e198 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:59.611906 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1771ec13-11df-4ee1-a852-26761a05e198 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:59.612373 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1771ec13-11df-4ee1-a852-26761a05e198 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:59.844613 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-1771ec13-11df-4ee1-a852-26761a05e198 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:59.856933 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-1771ec13-11df-4ee1-a852-26761a05e198 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:59.858986 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-1771ec13-11df-4ee1-a852-26761a05e198 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:43:59.867618 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-1771ec13-11df-4ee1-a852-26761a05e198 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1809 microversion: 2.20 time: 0.268782 Jun 23 22:43:59.869523 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 388/798] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:43:59 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1809 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:44:00.893493 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-27b4f0b4-0191-4cb3-a38b-e83a829ef1f7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:00.894252 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-27b4f0b4-0191-4cb3-a38b-e83a829ef1f7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:00.901448 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-27b4f0b4-0191-4cb3-a38b-e83a829ef1f7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:00.902017 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-27b4f0b4-0191-4cb3-a38b-e83a829ef1f7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:00.902878 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-27b4f0b4-0191-4cb3-a38b-e83a829ef1f7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:00.904059 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-27b4f0b4-0191-4cb3-a38b-e83a829ef1f7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:01.088213 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-27b4f0b4-0191-4cb3-a38b-e83a829ef1f7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:01.091254 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:44:01.100836 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-27b4f0b4-0191-4cb3-a38b-e83a829ef1f7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:01.102333 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-27b4f0b4-0191-4cb3-a38b-e83a829ef1f7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:01.103724 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-27b4f0b4-0191-4cb3-a38b-e83a829ef1f7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1809 microversion: 2.20 time: 0.215901 Jun 23 22:44:01.104911 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 411/799] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:44:00 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1809 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:44:02.123375 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-3e758751-b9d1-4efe-a689-f1eefe421921 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:02.124148 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-3e758751-b9d1-4efe-a689-f1eefe421921 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:02.130953 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3e758751-b9d1-4efe-a689-f1eefe421921 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:02.131484 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3e758751-b9d1-4efe-a689-f1eefe421921 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:02.132329 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3e758751-b9d1-4efe-a689-f1eefe421921 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:02.132834 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3e758751-b9d1-4efe-a689-f1eefe421921 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:02.268608 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-3e758751-b9d1-4efe-a689-f1eefe421921 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:02.276868 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-3e758751-b9d1-4efe-a689-f1eefe421921 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:02.279128 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-3e758751-b9d1-4efe-a689-f1eefe421921 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:02.280303 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-3e758751-b9d1-4efe-a689-f1eefe421921 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1809 microversion: 2.20 time: 0.161509 Jun 23 22:44:02.291188 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 389/800] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:44:02 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:44:03.298794 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-0c96b54e-98a7-4f1c-9e1d-07d3df2a4d95 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:03.299442 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-0c96b54e-98a7-4f1c-9e1d-07d3df2a4d95 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:03.302150 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_api:SELECT=32 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:44:03.308184 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-0c96b54e-98a7-4f1c-9e1d-07d3df2a4d95 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:03.308632 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-0c96b54e-98a7-4f1c-9e1d-07d3df2a4d95 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:03.309909 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-0c96b54e-98a7-4f1c-9e1d-07d3df2a4d95 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:03.310345 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-0c96b54e-98a7-4f1c-9e1d-07d3df2a4d95 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:03.454154 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-0c96b54e-98a7-4f1c-9e1d-07d3df2a4d95 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:03.462641 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-0c96b54e-98a7-4f1c-9e1d-07d3df2a4d95 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:03.464301 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-0c96b54e-98a7-4f1c-9e1d-07d3df2a4d95 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:03.465511 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-0c96b54e-98a7-4f1c-9e1d-07d3df2a4d95 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1809 microversion: 2.20 time: 0.170756 Jun 23 22:44:03.466339 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 412/801] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:44:03 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:44:04.484573 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-bf08617f-cb46-4665-ad21-e03dbcaaa72d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:04.485181 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-bf08617f-cb46-4665-ad21-e03dbcaaa72d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:04.492835 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bf08617f-cb46-4665-ad21-e03dbcaaa72d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:04.493283 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bf08617f-cb46-4665-ad21-e03dbcaaa72d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:04.494216 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bf08617f-cb46-4665-ad21-e03dbcaaa72d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:04.494648 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bf08617f-cb46-4665-ad21-e03dbcaaa72d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:04.627146 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-bf08617f-cb46-4665-ad21-e03dbcaaa72d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:04.636411 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-bf08617f-cb46-4665-ad21-e03dbcaaa72d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:04.639229 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-bf08617f-cb46-4665-ad21-e03dbcaaa72d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:04.640458 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-bf08617f-cb46-4665-ad21-e03dbcaaa72d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1809 microversion: 2.20 time: 0.160328 Jun 23 22:44:04.641016 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 390/802] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:44:04 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:44:05.661792 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-a7b094be-b0a0-47f4-a36c-56a3fa2cfe40 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:05.662521 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-a7b094be-b0a0-47f4-a36c-56a3fa2cfe40 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:05.673820 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a7b094be-b0a0-47f4-a36c-56a3fa2cfe40 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:05.674247 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a7b094be-b0a0-47f4-a36c-56a3fa2cfe40 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:05.675022 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a7b094be-b0a0-47f4-a36c-56a3fa2cfe40 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:05.675810 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a7b094be-b0a0-47f4-a36c-56a3fa2cfe40 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:05.843320 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-a7b094be-b0a0-47f4-a36c-56a3fa2cfe40 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:05.852472 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-a7b094be-b0a0-47f4-a36c-56a3fa2cfe40 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:05.854028 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-a7b094be-b0a0-47f4-a36c-56a3fa2cfe40 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:05.855268 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-a7b094be-b0a0-47f4-a36c-56a3fa2cfe40 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1809 microversion: 2.20 time: 0.199367 Jun 23 22:44:05.855824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 413/803] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:44:05 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1809 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:44:06.876367 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-576edb07-57d2-4fbf-be94-dd53986c13fc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:06.876973 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-576edb07-57d2-4fbf-be94-dd53986c13fc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:06.883637 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-576edb07-57d2-4fbf-be94-dd53986c13fc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:06.884103 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-576edb07-57d2-4fbf-be94-dd53986c13fc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:06.884862 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-576edb07-57d2-4fbf-be94-dd53986c13fc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:06.885285 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-576edb07-57d2-4fbf-be94-dd53986c13fc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:07.019733 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-576edb07-57d2-4fbf-be94-dd53986c13fc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:07.029667 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-576edb07-57d2-4fbf-be94-dd53986c13fc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:07.031193 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-576edb07-57d2-4fbf-be94-dd53986c13fc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:07.032408 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-576edb07-57d2-4fbf-be94-dd53986c13fc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1809 microversion: 2.20 time: 0.161424 Jun 23 22:44:07.032997 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 391/804] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:44:06 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:44:08.053405 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-7b2ed5b7-502d-44fd-a961-ca9eb68b86d8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:08.054002 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-7b2ed5b7-502d-44fd-a961-ca9eb68b86d8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:08.061281 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7b2ed5b7-502d-44fd-a961-ca9eb68b86d8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:08.061721 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7b2ed5b7-502d-44fd-a961-ca9eb68b86d8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:08.062471 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7b2ed5b7-502d-44fd-a961-ca9eb68b86d8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:08.062897 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7b2ed5b7-502d-44fd-a961-ca9eb68b86d8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:08.196006 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-7b2ed5b7-502d-44fd-a961-ca9eb68b86d8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:08.204609 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-7b2ed5b7-502d-44fd-a961-ca9eb68b86d8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:08.206118 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-7b2ed5b7-502d-44fd-a961-ca9eb68b86d8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:08.207310 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-7b2ed5b7-502d-44fd-a961-ca9eb68b86d8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1809 microversion: 2.20 time: 0.157951 Jun 23 22:44:08.207875 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 414/805] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:44:08 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:44:09.225556 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-aa7c7d40-3488-468a-ba23-00fdb217f3c5 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:09.226164 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-aa7c7d40-3488-468a-ba23-00fdb217f3c5 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:09.233527 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-aa7c7d40-3488-468a-ba23-00fdb217f3c5 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:09.233969 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-aa7c7d40-3488-468a-ba23-00fdb217f3c5 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:09.234730 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-aa7c7d40-3488-468a-ba23-00fdb217f3c5 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:09.235196 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-aa7c7d40-3488-468a-ba23-00fdb217f3c5 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:09.374003 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-aa7c7d40-3488-468a-ba23-00fdb217f3c5 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:09.382413 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-aa7c7d40-3488-468a-ba23-00fdb217f3c5 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:09.384046 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-aa7c7d40-3488-468a-ba23-00fdb217f3c5 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:09.385215 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-aa7c7d40-3488-468a-ba23-00fdb217f3c5 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1809 microversion: 2.20 time: 0.163585 Jun 23 22:44:09.385754 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 392/806] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:44:09 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:44:10.404014 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-f5d8d2c5-5656-4bbc-a640-860d242f85cb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:10.404617 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-f5d8d2c5-5656-4bbc-a640-860d242f85cb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:10.411008 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f5d8d2c5-5656-4bbc-a640-860d242f85cb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:10.411450 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f5d8d2c5-5656-4bbc-a640-860d242f85cb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:10.412206 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f5d8d2c5-5656-4bbc-a640-860d242f85cb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:10.412632 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f5d8d2c5-5656-4bbc-a640-860d242f85cb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:10.547872 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-f5d8d2c5-5656-4bbc-a640-860d242f85cb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:10.556307 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-f5d8d2c5-5656-4bbc-a640-860d242f85cb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:10.557947 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-f5d8d2c5-5656-4bbc-a640-860d242f85cb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:10.559305 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-f5d8d2c5-5656-4bbc-a640-860d242f85cb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1809 microversion: 2.20 time: 0.159126 Jun 23 22:44:10.559898 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 415/807] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:44:10 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:44:11.579170 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-fd6babca-a5a7-469d-9857-52d237e82592 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:11.579758 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-fd6babca-a5a7-469d-9857-52d237e82592 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:11.586099 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fd6babca-a5a7-469d-9857-52d237e82592 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:11.586566 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fd6babca-a5a7-469d-9857-52d237e82592 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:11.587339 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fd6babca-a5a7-469d-9857-52d237e82592 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:11.587764 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-fd6babca-a5a7-469d-9857-52d237e82592 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:11.723729 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-fd6babca-a5a7-469d-9857-52d237e82592 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:11.733264 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-fd6babca-a5a7-469d-9857-52d237e82592 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:11.735101 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-fd6babca-a5a7-469d-9857-52d237e82592 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:11.736398 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-fd6babca-a5a7-469d-9857-52d237e82592 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1809 microversion: 2.20 time: 0.161847 Jun 23 22:44:11.737044 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 393/808] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:44:11 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:44:12.755133 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-5bab594d-5d80-4be6-9c40-31c94a7df53b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:12.755792 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-5bab594d-5d80-4be6-9c40-31c94a7df53b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:12.763055 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5bab594d-5d80-4be6-9c40-31c94a7df53b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:12.764045 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5bab594d-5d80-4be6-9c40-31c94a7df53b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:12.765378 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5bab594d-5d80-4be6-9c40-31c94a7df53b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:12.765814 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5bab594d-5d80-4be6-9c40-31c94a7df53b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:12.901550 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-5bab594d-5d80-4be6-9c40-31c94a7df53b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:12.910780 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-5bab594d-5d80-4be6-9c40-31c94a7df53b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:12.912312 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-5bab594d-5d80-4be6-9c40-31c94a7df53b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:12.913533 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-5bab594d-5d80-4be6-9c40-31c94a7df53b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1809 microversion: 2.20 time: 0.162345 Jun 23 22:44:12.914126 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 416/809] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:44:12 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:44:13.933487 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a56ac3f7-ce94-4fd5-a3cb-329f331fce7f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:13.934091 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-a56ac3f7-ce94-4fd5-a3cb-329f331fce7f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:13.940653 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a56ac3f7-ce94-4fd5-a3cb-329f331fce7f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:13.941094 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a56ac3f7-ce94-4fd5-a3cb-329f331fce7f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:13.941849 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a56ac3f7-ce94-4fd5-a3cb-329f331fce7f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:13.942281 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a56ac3f7-ce94-4fd5-a3cb-329f331fce7f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:14.070678 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-a56ac3f7-ce94-4fd5-a3cb-329f331fce7f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:14.080402 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-a56ac3f7-ce94-4fd5-a3cb-329f331fce7f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:14.081834 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-a56ac3f7-ce94-4fd5-a3cb-329f331fce7f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:14.083015 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-a56ac3f7-ce94-4fd5-a3cb-329f331fce7f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1809 microversion: 2.20 time: 0.153437 Jun 23 22:44:14.083574 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 394/810] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:44:13 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:44:14.566150 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [req-6da31615-89ff-4165-877b-70f172a10620 req-16ec40f9-5124-44db-aa6b-0e5995770a99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b2f6937-650f-42b2-83cb-f2f54c40a6b3", "name": "network-vif-plugged", "status": "completed", "tag": "25e676fe-9948-4de4-91ae-b15fb391a86c"}]} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:44:14.575650 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-6da31615-89ff-4165-877b-70f172a10620 req-16ec40f9-5124-44db-aa6b-0e5995770a99 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:14.576093 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-6da31615-89ff-4165-877b-70f172a10620 req-16ec40f9-5124-44db-aa6b-0e5995770a99 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:14.587672 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.compute.server_external_events [req-6da31615-89ff-4165-877b-70f172a10620 req-16ec40f9-5124-44db-aa6b-0e5995770a99 service nova] Creating event network-vif-plugged:25e676fe-9948-4de4-91ae-b15fb391a86c for instance 7b2f6937-650f-42b2-83cb-f2f54c40a6b3 on hv-cinder-84617 Jun 23 22:44:14.593134 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [req-6da31615-89ff-4165-877b-70f172a10620 req-16ec40f9-5124-44db-aa6b-0e5995770a99 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030713 Jun 23 22:44:14.594057 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 417/811] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:44:15.101722 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f1fcbfb2-fa69-4b4d-b84b-00ddca1e0884 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:15.102337 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-f1fcbfb2-fa69-4b4d-b84b-00ddca1e0884 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:15.109835 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f1fcbfb2-fa69-4b4d-b84b-00ddca1e0884 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:15.110280 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f1fcbfb2-fa69-4b4d-b84b-00ddca1e0884 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:15.111082 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f1fcbfb2-fa69-4b4d-b84b-00ddca1e0884 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:15.111524 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f1fcbfb2-fa69-4b4d-b84b-00ddca1e0884 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:15.309401 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f1fcbfb2-fa69-4b4d-b84b-00ddca1e0884 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:15.319385 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f1fcbfb2-fa69-4b4d-b84b-00ddca1e0884 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:15.320983 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f1fcbfb2-fa69-4b4d-b84b-00ddca1e0884 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:15.322376 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f1fcbfb2-fa69-4b4d-b84b-00ddca1e0884 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1809 microversion: 2.20 time: 0.224469 Jun 23 22:44:15.323039 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 395/812] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:44:15 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1809 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:44:15.469544 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-a27c582d-2e9b-4cae-ae0a-1121013afc8a tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1917699773", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-932418013", "security_groups": [{"name": "tempest-secgroup-smoke-2066458815"}], "block_device_mapping_v2": [{"uuid": "9db27eaa-2295-4e42-85b7-a9a00cf53120", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0799b4b1-d9c3-4fcf-beb9-9324c17ca4f1"}]}} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:44:15.586787 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.network.neutron [None req-a27c582d-2e9b-4cae-ae0a-1121013afc8a tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] validate_networks() for [('0799b4b1-d9c3-4fcf-beb9-9324c17ca4f1', None, None, None, None, None)] {{(pid=124357) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:44:15.962102 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-a27c582d-2e9b-4cae-ae0a-1121013afc8a tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Flavor limits 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:44:15.962557 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-a27c582d-2e9b-4cae-ae0a-1121013afc8a tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Image limits 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:44:15.963070 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-a27c582d-2e9b-4cae-ae0a-1121013afc8a tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Flavor pref 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:44:15.963481 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-a27c582d-2e9b-4cae-ae0a-1121013afc8a tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Image pref 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:44:15.963923 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-a27c582d-2e9b-4cae-ae0a-1121013afc8a tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:44:15.974531 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a27c582d-2e9b-4cae-ae0a-1121013afc8a tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:15.975004 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a27c582d-2e9b-4cae-ae0a-1121013afc8a tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:15.975825 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a27c582d-2e9b-4cae-ae0a-1121013afc8a tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:15.976252 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a27c582d-2e9b-4cae-ae0a-1121013afc8a tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:15.993134 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-a27c582d-2e9b-4cae-ae0a-1121013afc8a tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Getting quotas for project 1eb4b659032e4ec09a16c45b29d609f0. Resources: {'instances', 'cores', 'ram'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:44:15.997003 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-a27c582d-2e9b-4cae-ae0a-1121013afc8a tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Getting quotas for user f523b529906f4fa989d0e836d6a08944 and project 1eb4b659032e4ec09a16c45b29d609f0. Resources: {'instances', 'cores', 'ram'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:44:16.053914 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-a27c582d-2e9b-4cae-ae0a-1121013afc8a tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Going to run 1 instances... {{(pid=124357) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:44:16.056121 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-a27c582d-2e9b-4cae-ae0a-1121013afc8a tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 60c4a691-2c7d-4621-bfad-17e7a30b5724] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9db27eaa-2295-4e42-85b7-a9a00cf53120',volume_size=None,volume_type=None)] {{(pid=124357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:44:16.184666 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-a27c582d-2e9b-4cae-ae0a-1121013afc8a tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.719648 Jun 23 22:44:16.185308 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 418/813] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Jun 23 22:44:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 22:44:16.195138 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c53e8889-0878-4004-bb1b-7ef041b9fa24 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:16.195755 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c53e8889-0878-4004-bb1b-7ef041b9fa24 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 60c4a691-2c7d-4621-bfad-17e7a30b5724] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:16.249244 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c53e8889-0878-4004-bb1b-7ef041b9fa24 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:16.255861 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c53e8889-0878-4004-bb1b-7ef041b9fa24 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724" status: 200 len: 1094 microversion: 2.1 time: 0.064471 Jun 23 22:44:16.256581 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 396/814] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:16 2022] GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:44:16.341679 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-c1ed5dd8-0a64-4a22-90ea-9fee7eff5e5a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:16.342410 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-c1ed5dd8-0a64-4a22-90ea-9fee7eff5e5a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:16.349225 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c1ed5dd8-0a64-4a22-90ea-9fee7eff5e5a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:16.349994 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c1ed5dd8-0a64-4a22-90ea-9fee7eff5e5a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:16.350815 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c1ed5dd8-0a64-4a22-90ea-9fee7eff5e5a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:16.351437 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c1ed5dd8-0a64-4a22-90ea-9fee7eff5e5a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:16.488322 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-c1ed5dd8-0a64-4a22-90ea-9fee7eff5e5a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:16.497150 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-c1ed5dd8-0a64-4a22-90ea-9fee7eff5e5a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:16.498952 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-c1ed5dd8-0a64-4a22-90ea-9fee7eff5e5a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:16.500166 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-c1ed5dd8-0a64-4a22-90ea-9fee7eff5e5a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1809 microversion: 2.20 time: 0.163243 Jun 23 22:44:16.501207 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 419/815] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:44:16 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:44:17.273694 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-bb776913-eeee-4f15-bfbc-9b7c14d1f310 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:17.274462 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-bb776913-eeee-4f15-bfbc-9b7c14d1f310 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 60c4a691-2c7d-4621-bfad-17e7a30b5724] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:17.282806 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bb776913-eeee-4f15-bfbc-9b7c14d1f310 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:17.283292 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bb776913-eeee-4f15-bfbc-9b7c14d1f310 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:17.284072 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bb776913-eeee-4f15-bfbc-9b7c14d1f310 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:17.284545 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bb776913-eeee-4f15-bfbc-9b7c14d1f310 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:17.354039 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-bb776913-eeee-4f15-bfbc-9b7c14d1f310 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:17.361643 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-bb776913-eeee-4f15-bfbc-9b7c14d1f310 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724" status: 200 len: 1192 microversion: 2.1 time: 0.092200 Jun 23 22:44:17.362214 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 397/816] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:17 2022] GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724 => generated 1192 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:44:17.523079 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-30ee7848-d558-4e0a-8719-d64169064dfd tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:17.524340 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-30ee7848-d558-4e0a-8719-d64169064dfd tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:17.531470 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-30ee7848-d558-4e0a-8719-d64169064dfd tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:17.531933 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-30ee7848-d558-4e0a-8719-d64169064dfd tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:17.532700 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-30ee7848-d558-4e0a-8719-d64169064dfd tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:17.533133 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-30ee7848-d558-4e0a-8719-d64169064dfd tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:17.665097 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-30ee7848-d558-4e0a-8719-d64169064dfd tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:17.674495 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-30ee7848-d558-4e0a-8719-d64169064dfd tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:17.676039 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-30ee7848-d558-4e0a-8719-d64169064dfd tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:17.677219 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-30ee7848-d558-4e0a-8719-d64169064dfd tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1796 microversion: 2.20 time: 0.158427 Jun 23 22:44:17.677783 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 420/817] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:44:17 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1796 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:44:18.379076 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f3f2cdc4-c781-4e83-8eb6-f527fa8fbbee tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:18.379762 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-f3f2cdc4-c781-4e83-8eb6-f527fa8fbbee tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 60c4a691-2c7d-4621-bfad-17e7a30b5724] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:18.386173 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f3f2cdc4-c781-4e83-8eb6-f527fa8fbbee tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:18.386619 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f3f2cdc4-c781-4e83-8eb6-f527fa8fbbee tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:18.387510 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f3f2cdc4-c781-4e83-8eb6-f527fa8fbbee tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:18.388447 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f3f2cdc4-c781-4e83-8eb6-f527fa8fbbee tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:18.454049 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f3f2cdc4-c781-4e83-8eb6-f527fa8fbbee tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:18.461792 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f3f2cdc4-c781-4e83-8eb6-f527fa8fbbee tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724" status: 200 len: 1210 microversion: 2.1 time: 0.086659 Jun 23 22:44:18.462606 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 398/818] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:18 2022] GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724 => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:44:19.400804 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [req-a580b777-8b28-458e-8630-f56cf280f1d1 req-89ee74b4-8c3b-4347-87da-4b657b2c830d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60c4a691-2c7d-4621-bfad-17e7a30b5724", "tag": "28262990-c9a0-4ed8-bafe-2a4ebcc543dd"}]} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:44:19.410003 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-a580b777-8b28-458e-8630-f56cf280f1d1 req-89ee74b4-8c3b-4347-87da-4b657b2c830d service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:19.410533 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-a580b777-8b28-458e-8630-f56cf280f1d1 req-89ee74b4-8c3b-4347-87da-4b657b2c830d service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:19.423844 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.compute.server_external_events [req-a580b777-8b28-458e-8630-f56cf280f1d1 req-89ee74b4-8c3b-4347-87da-4b657b2c830d service nova] Creating event network-changed:28262990-c9a0-4ed8-bafe-2a4ebcc543dd for instance 60c4a691-2c7d-4621-bfad-17e7a30b5724 on hv-cinder-84617 Jun 23 22:44:19.429516 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [req-a580b777-8b28-458e-8630-f56cf280f1d1 req-89ee74b4-8c3b-4347-87da-4b657b2c830d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033742 Jun 23 22:44:19.429957 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 421/819] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:44:19.479238 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c1eed9bc-abbb-405a-ba67-cb77bd529e40 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:19.480367 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c1eed9bc-abbb-405a-ba67-cb77bd529e40 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 60c4a691-2c7d-4621-bfad-17e7a30b5724] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:19.488320 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c1eed9bc-abbb-405a-ba67-cb77bd529e40 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:19.489143 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c1eed9bc-abbb-405a-ba67-cb77bd529e40 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:19.490800 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c1eed9bc-abbb-405a-ba67-cb77bd529e40 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:19.491404 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c1eed9bc-abbb-405a-ba67-cb77bd529e40 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:19.722912 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c1eed9bc-abbb-405a-ba67-cb77bd529e40 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:19.730410 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c1eed9bc-abbb-405a-ba67-cb77bd529e40 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724" status: 200 len: 1266 microversion: 2.1 time: 0.255227 Jun 23 22:44:19.730999 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 399/820] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:19 2022] GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724 => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:44:20.748553 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-9587fda0-6b22-4b0b-b395-e229419722dc tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:20.749245 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-9587fda0-6b22-4b0b-b395-e229419722dc tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 60c4a691-2c7d-4621-bfad-17e7a30b5724] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:20.755320 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9587fda0-6b22-4b0b-b395-e229419722dc tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:20.755754 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9587fda0-6b22-4b0b-b395-e229419722dc tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:20.756547 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9587fda0-6b22-4b0b-b395-e229419722dc tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:20.756920 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9587fda0-6b22-4b0b-b395-e229419722dc tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:20.891159 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-9587fda0-6b22-4b0b-b395-e229419722dc tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:20.898569 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-9587fda0-6b22-4b0b-b395-e229419722dc tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724" status: 200 len: 1266 microversion: 2.1 time: 0.154913 Jun 23 22:44:20.899193 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 422/821] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:20 2022] GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:44:21.916112 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-20e2aacb-8070-4b49-8f60-a580f6811cf0 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:21.916753 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-20e2aacb-8070-4b49-8f60-a580f6811cf0 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 60c4a691-2c7d-4621-bfad-17e7a30b5724] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:21.924425 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-20e2aacb-8070-4b49-8f60-a580f6811cf0 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:21.924858 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-20e2aacb-8070-4b49-8f60-a580f6811cf0 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:21.925614 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-20e2aacb-8070-4b49-8f60-a580f6811cf0 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:21.926038 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-20e2aacb-8070-4b49-8f60-a580f6811cf0 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:21.929899 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:44:22.054594 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-20e2aacb-8070-4b49-8f60-a580f6811cf0 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:22.062563 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-20e2aacb-8070-4b49-8f60-a580f6811cf0 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724" status: 200 len: 1266 microversion: 2.1 time: 0.150301 Jun 23 22:44:22.063163 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 400/822] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:21 2022] GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:44:23.080056 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-91a61fbf-2172-4dfc-8998-f3386c49aef1 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:23.080660 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-91a61fbf-2172-4dfc-8998-f3386c49aef1 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 60c4a691-2c7d-4621-bfad-17e7a30b5724] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:23.087091 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-91a61fbf-2172-4dfc-8998-f3386c49aef1 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:23.087535 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-91a61fbf-2172-4dfc-8998-f3386c49aef1 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:23.088284 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-91a61fbf-2172-4dfc-8998-f3386c49aef1 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:23.088706 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-91a61fbf-2172-4dfc-8998-f3386c49aef1 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:23.223297 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-91a61fbf-2172-4dfc-8998-f3386c49aef1 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:23.230672 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-91a61fbf-2172-4dfc-8998-f3386c49aef1 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724" status: 200 len: 1266 microversion: 2.1 time: 0.155239 Jun 23 22:44:23.231278 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 423/823] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:23 2022] GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:44:24.247335 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-5960e162-12b4-431c-8b9c-a63b6ca2195f tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:24.247951 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-5960e162-12b4-431c-8b9c-a63b6ca2195f tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 60c4a691-2c7d-4621-bfad-17e7a30b5724] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:24.254559 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5960e162-12b4-431c-8b9c-a63b6ca2195f tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:24.255042 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5960e162-12b4-431c-8b9c-a63b6ca2195f tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:24.255806 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5960e162-12b4-431c-8b9c-a63b6ca2195f tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:24.256240 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5960e162-12b4-431c-8b9c-a63b6ca2195f tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:24.387795 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-5960e162-12b4-431c-8b9c-a63b6ca2195f tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:24.395924 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-5960e162-12b4-431c-8b9c-a63b6ca2195f tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724" status: 200 len: 1266 microversion: 2.1 time: 0.152470 Jun 23 22:44:24.396490 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 401/824] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:24 2022] GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:44:25.412630 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-60fc650a-4357-4828-84a5-d4aecaac25c8 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:25.413171 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-60fc650a-4357-4828-84a5-d4aecaac25c8 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 60c4a691-2c7d-4621-bfad-17e7a30b5724] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:25.419813 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-60fc650a-4357-4828-84a5-d4aecaac25c8 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:25.420251 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-60fc650a-4357-4828-84a5-d4aecaac25c8 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:25.420999 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-60fc650a-4357-4828-84a5-d4aecaac25c8 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:25.421423 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-60fc650a-4357-4828-84a5-d4aecaac25c8 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:25.554069 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-60fc650a-4357-4828-84a5-d4aecaac25c8 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:25.561511 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-60fc650a-4357-4828-84a5-d4aecaac25c8 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724" status: 200 len: 1266 microversion: 2.1 time: 0.152854 Jun 23 22:44:25.562844 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 424/825] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:25 2022] GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:44:26.579276 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-76c86554-464f-4b18-a4e4-c1277da94158 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:26.579813 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-76c86554-464f-4b18-a4e4-c1277da94158 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 60c4a691-2c7d-4621-bfad-17e7a30b5724] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:26.582075 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=2 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:44:26.587556 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-76c86554-464f-4b18-a4e4-c1277da94158 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:26.587993 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-76c86554-464f-4b18-a4e4-c1277da94158 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:26.588766 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-76c86554-464f-4b18-a4e4-c1277da94158 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:26.589191 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-76c86554-464f-4b18-a4e4-c1277da94158 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:26.716833 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-76c86554-464f-4b18-a4e4-c1277da94158 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:26.724565 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-76c86554-464f-4b18-a4e4-c1277da94158 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724" status: 200 len: 1266 microversion: 2.1 time: 0.149659 Jun 23 22:44:26.725131 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 402/826] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:26 2022] GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:44:27.740960 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-cffefc7a-e5ac-43ed-ad02-65b8e792bf2b tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:27.741567 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-cffefc7a-e5ac-43ed-ad02-65b8e792bf2b tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 60c4a691-2c7d-4621-bfad-17e7a30b5724] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:27.743535 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell0:SELECT=2 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:44:27.744178 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell0:SELECT=6 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:44:27.750636 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-cffefc7a-e5ac-43ed-ad02-65b8e792bf2b tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:27.751102 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-cffefc7a-e5ac-43ed-ad02-65b8e792bf2b tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:27.751854 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-cffefc7a-e5ac-43ed-ad02-65b8e792bf2b tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:27.752280 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-cffefc7a-e5ac-43ed-ad02-65b8e792bf2b tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:27.882176 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-cffefc7a-e5ac-43ed-ad02-65b8e792bf2b tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:27.889496 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-cffefc7a-e5ac-43ed-ad02-65b8e792bf2b tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724" status: 200 len: 1266 microversion: 2.1 time: 0.152339 Jun 23 22:44:27.890792 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 425/827] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:27 2022] GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:44:28.906977 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-4502efd7-93fd-4b3f-98d9-81850911a1d9 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:28.907523 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-4502efd7-93fd-4b3f-98d9-81850911a1d9 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 60c4a691-2c7d-4621-bfad-17e7a30b5724] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:28.913710 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4502efd7-93fd-4b3f-98d9-81850911a1d9 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:28.914148 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4502efd7-93fd-4b3f-98d9-81850911a1d9 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:28.914901 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4502efd7-93fd-4b3f-98d9-81850911a1d9 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:28.915360 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4502efd7-93fd-4b3f-98d9-81850911a1d9 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:29.045423 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4502efd7-93fd-4b3f-98d9-81850911a1d9 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:29.052939 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-4502efd7-93fd-4b3f-98d9-81850911a1d9 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724" status: 200 len: 1266 microversion: 2.1 time: 0.150416 Jun 23 22:44:29.053529 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 403/828] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:28 2022] GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:44:30.070043 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-3e9f07e5-d701-4b92-b338-61a7c576cd3e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:30.070630 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-3e9f07e5-d701-4b92-b338-61a7c576cd3e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 60c4a691-2c7d-4621-bfad-17e7a30b5724] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:30.077062 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3e9f07e5-d701-4b92-b338-61a7c576cd3e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:30.077494 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3e9f07e5-d701-4b92-b338-61a7c576cd3e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:30.078317 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3e9f07e5-d701-4b92-b338-61a7c576cd3e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:30.079094 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3e9f07e5-d701-4b92-b338-61a7c576cd3e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:30.209195 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-3e9f07e5-d701-4b92-b338-61a7c576cd3e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:30.216549 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-3e9f07e5-d701-4b92-b338-61a7c576cd3e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724" status: 200 len: 1266 microversion: 2.1 time: 0.150313 Jun 23 22:44:30.217110 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 426/829] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:30 2022] GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:44:31.233964 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-13c58a31-8354-4716-82a6-eb51d17dada0 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:31.234659 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-13c58a31-8354-4716-82a6-eb51d17dada0 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 60c4a691-2c7d-4621-bfad-17e7a30b5724] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:31.237383 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=34 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:44:31.243181 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-13c58a31-8354-4716-82a6-eb51d17dada0 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:31.243624 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-13c58a31-8354-4716-82a6-eb51d17dada0 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:31.244395 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-13c58a31-8354-4716-82a6-eb51d17dada0 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:31.244827 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-13c58a31-8354-4716-82a6-eb51d17dada0 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:31.378546 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-13c58a31-8354-4716-82a6-eb51d17dada0 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:31.386071 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-13c58a31-8354-4716-82a6-eb51d17dada0 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724" status: 200 len: 1266 microversion: 2.1 time: 0.156253 Jun 23 22:44:31.386643 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 404/830] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:31 2022] GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:44:32.404129 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-84b7f3e2-266e-42b0-9ca9-78ce00b9d5c9 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:32.404730 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-84b7f3e2-266e-42b0-9ca9-78ce00b9d5c9 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 60c4a691-2c7d-4621-bfad-17e7a30b5724] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:32.411776 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-84b7f3e2-266e-42b0-9ca9-78ce00b9d5c9 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:32.412217 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-84b7f3e2-266e-42b0-9ca9-78ce00b9d5c9 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:32.412964 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-84b7f3e2-266e-42b0-9ca9-78ce00b9d5c9 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:32.413389 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-84b7f3e2-266e-42b0-9ca9-78ce00b9d5c9 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:32.551374 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-84b7f3e2-266e-42b0-9ca9-78ce00b9d5c9 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:32.559178 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-84b7f3e2-266e-42b0-9ca9-78ce00b9d5c9 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724" status: 200 len: 1266 microversion: 2.1 time: 0.158817 Jun 23 22:44:32.559732 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 427/831] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:32 2022] GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:44:33.576609 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b245a5f6-aa3e-4bb8-ae6a-3eae26aa340d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:33.577221 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-b245a5f6-aa3e-4bb8-ae6a-3eae26aa340d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 60c4a691-2c7d-4621-bfad-17e7a30b5724] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:33.584420 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b245a5f6-aa3e-4bb8-ae6a-3eae26aa340d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:33.584798 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b245a5f6-aa3e-4bb8-ae6a-3eae26aa340d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:33.585567 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b245a5f6-aa3e-4bb8-ae6a-3eae26aa340d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:33.586002 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b245a5f6-aa3e-4bb8-ae6a-3eae26aa340d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:33.721831 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b245a5f6-aa3e-4bb8-ae6a-3eae26aa340d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:33.730274 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-b245a5f6-aa3e-4bb8-ae6a-3eae26aa340d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724" status: 200 len: 1266 microversion: 2.1 time: 0.157491 Jun 23 22:44:33.730944 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 405/832] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:33 2022] GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:44:34.747661 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-751c284f-95f9-4828-8617-0bd33d5e73dd tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:34.748204 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-751c284f-95f9-4828-8617-0bd33d5e73dd tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 60c4a691-2c7d-4621-bfad-17e7a30b5724] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:34.750491 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:44:34.756554 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-751c284f-95f9-4828-8617-0bd33d5e73dd tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:34.757001 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-751c284f-95f9-4828-8617-0bd33d5e73dd tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:34.757765 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-751c284f-95f9-4828-8617-0bd33d5e73dd tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:34.758224 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-751c284f-95f9-4828-8617-0bd33d5e73dd tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:34.762888 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell1:SELECT=86 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:44:34.889739 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-751c284f-95f9-4828-8617-0bd33d5e73dd tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:34.897935 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-751c284f-95f9-4828-8617-0bd33d5e73dd tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724" status: 200 len: 1266 microversion: 2.1 time: 0.154216 Jun 23 22:44:34.898410 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 428/833] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:34 2022] GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:44:34.915921 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-8cdfdef2-ca3f-427c-87e5-40e6bba32536 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1523411804", "imageRef": "ac7d441e-2ac8-49ad-9dc5-3c55bd4b4f8b", "flavorRef": "452", "networks": [{"uuid": "c5b80e41-df9f-4702-ac94-81d6f7484421"}]}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:44:34.969771 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.network.neutron [None req-8cdfdef2-ca3f-427c-87e5-40e6bba32536 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] validate_networks() for [('c5b80e41-df9f-4702-ac94-81d6f7484421', None, None, None, None, None)] {{(pid=124358) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:44:35.575326 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-8cdfdef2-ca3f-427c-87e5-40e6bba32536 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Flavor limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:44:35.575747 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-8cdfdef2-ca3f-427c-87e5-40e6bba32536 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Image limits 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:44:35.576239 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-8cdfdef2-ca3f-427c-87e5-40e6bba32536 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Flavor pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:44:35.576642 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-8cdfdef2-ca3f-427c-87e5-40e6bba32536 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Image pref 0:0:0 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:44:35.577072 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.virt.hardware [None req-8cdfdef2-ca3f-427c-87e5-40e6bba32536 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124358) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:44:35.587351 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8cdfdef2-ca3f-427c-87e5-40e6bba32536 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:35.587798 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8cdfdef2-ca3f-427c-87e5-40e6bba32536 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:35.588597 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8cdfdef2-ca3f-427c-87e5-40e6bba32536 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:35.589021 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8cdfdef2-ca3f-427c-87e5-40e6bba32536 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:35.606153 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-8cdfdef2-ca3f-427c-87e5-40e6bba32536 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Getting quotas for project 65a0d4c968d84b02977004edf46cde48. Resources: {'instances', 'cores', 'ram'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:44:35.610251 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-8cdfdef2-ca3f-427c-87e5-40e6bba32536 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Getting quotas for user f87b9f9f1adc4c2bb9da82df9d27802e and project 65a0d4c968d84b02977004edf46cde48. Resources: {'instances', 'cores', 'ram'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:44:35.621980 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-8cdfdef2-ca3f-427c-87e5-40e6bba32536 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Going to run 1 instances... {{(pid=124358) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:44:35.624265 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-8cdfdef2-ca3f-427c-87e5-40e6bba32536 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] [instance: 9717199a-93d2-479c-a903-818a5e93b841] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ac7d441e-2ac8-49ad-9dc5-3c55bd4b4f8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124358) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:44:35.670093 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-8cdfdef2-ca3f-427c-87e5-40e6bba32536 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.757783 Jun 23 22:44:35.675588 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 406/834] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Jun 23 22:44:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 23 22:44:35.680731 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-4692a8c8-7fd3-496c-b50e-8d07a5177aa2 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:35.681421 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-4692a8c8-7fd3-496c-b50e-8d07a5177aa2 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] [instance: 9717199a-93d2-479c-a903-818a5e93b841] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:35.747755 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-4692a8c8-7fd3-496c-b50e-8d07a5177aa2 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87b9f9f1adc4c2bb9da82df9d27802e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a0d4c968d84b02977004edf46cde48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:35.756498 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-4692a8c8-7fd3-496c-b50e-8d07a5177aa2 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] 10.222.0.43 "GET /compute/v2.1/servers/9717199a-93d2-479c-a903-818a5e93b841" status: 200 len: 1219 microversion: 2.1 time: 0.079540 Jun 23 22:44:35.757066 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 429/835] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:35 2022] GET /compute/v2.1/servers/9717199a-93d2-479c-a903-818a5e93b841 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:44:35.914086 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d6fcf1a7-b4c2-480c-83bb-c62120b26ef0 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:35.914656 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-d6fcf1a7-b4c2-480c-83bb-c62120b26ef0 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 60c4a691-2c7d-4621-bfad-17e7a30b5724] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:35.921760 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d6fcf1a7-b4c2-480c-83bb-c62120b26ef0 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:35.922400 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d6fcf1a7-b4c2-480c-83bb-c62120b26ef0 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:35.922959 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d6fcf1a7-b4c2-480c-83bb-c62120b26ef0 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:35.923350 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d6fcf1a7-b4c2-480c-83bb-c62120b26ef0 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:36.095159 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d6fcf1a7-b4c2-480c-83bb-c62120b26ef0 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:36.104003 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d6fcf1a7-b4c2-480c-83bb-c62120b26ef0 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724" status: 200 len: 1266 microversion: 2.1 time: 0.193804 Jun 23 22:44:36.104681 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 407/836] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:35 2022] GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:44:36.381925 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-49f0705a-e58d-4712-a75c-7b2dd4d475d8 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:36.382516 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-49f0705a-e58d-4712-a75c-7b2dd4d475d8 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:36.389247 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-49f0705a-e58d-4712-a75c-7b2dd4d475d8 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:36.389706 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-49f0705a-e58d-4712-a75c-7b2dd4d475d8 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:36.390475 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-49f0705a-e58d-4712-a75c-7b2dd4d475d8 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:36.391136 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-49f0705a-e58d-4712-a75c-7b2dd4d475d8 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:36.419139 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-49f0705a-e58d-4712-a75c-7b2dd4d475d8 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Going to try to terminate instance {{(pid=124357) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:44:36.503674 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-49f0705a-e58d-4712-a75c-7b2dd4d475d8 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "DELETE /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 204 len: 0 microversion: 2.1 time: 0.125255 Jun 23 22:44:36.504698 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 430/837] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 23 22:44:36 2022] DELETE /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 22:44:36.511457 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-601db452-1e76-40c4-9dba-cc9dc5250256 req-78264031-a016-4531-a5a8-886f8b8bf23e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "628515ea-c2f6-490f-a67d-13d0e97698ac", "tag": "0b2f39d0-0fe2-4db8-9e32-5112a69d2b21"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:44:36.513076 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-ddafbb4b-91ca-4656-b395-0ebfb4a2f848 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:36.513837 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-ddafbb4b-91ca-4656-b395-0ebfb4a2f848 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:36.520693 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ddafbb4b-91ca-4656-b395-0ebfb4a2f848 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:36.521007 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-601db452-1e76-40c4-9dba-cc9dc5250256 req-78264031-a016-4531-a5a8-886f8b8bf23e service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:36.521254 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ddafbb4b-91ca-4656-b395-0ebfb4a2f848 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:36.521449 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-601db452-1e76-40c4-9dba-cc9dc5250256 req-78264031-a016-4531-a5a8-886f8b8bf23e service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:36.522159 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ddafbb4b-91ca-4656-b395-0ebfb4a2f848 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:36.522654 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ddafbb4b-91ca-4656-b395-0ebfb4a2f848 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:36.533158 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-601db452-1e76-40c4-9dba-cc9dc5250256 req-78264031-a016-4531-a5a8-886f8b8bf23e service nova] Creating event network-changed:0b2f39d0-0fe2-4db8-9e32-5112a69d2b21 for instance 628515ea-c2f6-490f-a67d-13d0e97698ac on hv-cinder-84617 Jun 23 22:44:36.538869 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-601db452-1e76-40c4-9dba-cc9dc5250256 req-78264031-a016-4531-a5a8-886f8b8bf23e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158305 Jun 23 22:44:36.539805 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 408/838] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:44:36.656304 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-ddafbb4b-91ca-4656-b395-0ebfb4a2f848 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:36.664084 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-ddafbb4b-91ca-4656-b395-0ebfb4a2f848 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1567 microversion: 2.1 time: 0.155134 Jun 23 22:44:36.664734 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 431/839] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:36 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:44:36.772947 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-7ab1095f-a831-48f3-b42d-03a3ba99f54f tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:36.773589 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-7ab1095f-a831-48f3-b42d-03a3ba99f54f tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] [instance: 9717199a-93d2-479c-a903-818a5e93b841] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:36.779881 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7ab1095f-a831-48f3-b42d-03a3ba99f54f tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:36.780328 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7ab1095f-a831-48f3-b42d-03a3ba99f54f tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:36.781102 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7ab1095f-a831-48f3-b42d-03a3ba99f54f tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:36.781537 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7ab1095f-a831-48f3-b42d-03a3ba99f54f tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:36.849206 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-7ab1095f-a831-48f3-b42d-03a3ba99f54f tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87b9f9f1adc4c2bb9da82df9d27802e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a0d4c968d84b02977004edf46cde48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:36.856745 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-7ab1095f-a831-48f3-b42d-03a3ba99f54f tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] 10.222.0.43 "GET /compute/v2.1/servers/9717199a-93d2-479c-a903-818a5e93b841" status: 200 len: 1223 microversion: 2.1 time: 0.088116 Jun 23 22:44:36.857316 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 409/840] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:36 2022] GET /compute/v2.1/servers/9717199a-93d2-479c-a903-818a5e93b841 => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:44:37.122159 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-e1b47721-b11c-4f16-a282-577d17910bdb tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:37.122867 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-e1b47721-b11c-4f16-a282-577d17910bdb tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 60c4a691-2c7d-4621-bfad-17e7a30b5724] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:37.129877 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-e1b47721-b11c-4f16-a282-577d17910bdb tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:37.130323 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-e1b47721-b11c-4f16-a282-577d17910bdb tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:37.131298 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-e1b47721-b11c-4f16-a282-577d17910bdb tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:37.131743 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-e1b47721-b11c-4f16-a282-577d17910bdb tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:37.273867 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-e1b47721-b11c-4f16-a282-577d17910bdb tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:37.281536 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-e1b47721-b11c-4f16-a282-577d17910bdb tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724" status: 200 len: 1266 microversion: 2.1 time: 0.164485 Jun 23 22:44:37.282103 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 432/841] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:37 2022] GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:44:37.683159 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-eea61651-d2e7-473d-8566-d36cb8d87367 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:37.683677 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-eea61651-d2e7-473d-8566-d36cb8d87367 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:37.690273 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-eea61651-d2e7-473d-8566-d36cb8d87367 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:37.690702 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-eea61651-d2e7-473d-8566-d36cb8d87367 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:37.691469 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-eea61651-d2e7-473d-8566-d36cb8d87367 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:37.691892 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-eea61651-d2e7-473d-8566-d36cb8d87367 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:37.821865 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-eea61651-d2e7-473d-8566-d36cb8d87367 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:37.829311 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-eea61651-d2e7-473d-8566-d36cb8d87367 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1567 microversion: 2.1 time: 0.150071 Jun 23 22:44:37.829874 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 410/842] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:37 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:44:37.873694 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-7153a5ac-2916-480e-a070-1c169e4f9ca9 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:37.874299 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-7153a5ac-2916-480e-a070-1c169e4f9ca9 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] [instance: 9717199a-93d2-479c-a903-818a5e93b841] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:37.881167 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7153a5ac-2916-480e-a070-1c169e4f9ca9 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:37.881609 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7153a5ac-2916-480e-a070-1c169e4f9ca9 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:37.882363 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7153a5ac-2916-480e-a070-1c169e4f9ca9 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:37.882793 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-7153a5ac-2916-480e-a070-1c169e4f9ca9 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:37.947937 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-7153a5ac-2916-480e-a070-1c169e4f9ca9 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87b9f9f1adc4c2bb9da82df9d27802e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a0d4c968d84b02977004edf46cde48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:37.957503 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-7153a5ac-2916-480e-a070-1c169e4f9ca9 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] 10.222.0.43 "GET /compute/v2.1/servers/9717199a-93d2-479c-a903-818a5e93b841" status: 200 len: 1223 microversion: 2.1 time: 0.087623 Jun 23 22:44:37.958074 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 433/843] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:37 2022] GET /compute/v2.1/servers/9717199a-93d2-479c-a903-818a5e93b841 => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:44:38.300051 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-36c9dd5c-dbd8-4458-8bb8-672cd4907e3a tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:38.300668 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-36c9dd5c-dbd8-4458-8bb8-672cd4907e3a tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 60c4a691-2c7d-4621-bfad-17e7a30b5724] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:38.306644 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-36c9dd5c-dbd8-4458-8bb8-672cd4907e3a tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:38.307125 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-36c9dd5c-dbd8-4458-8bb8-672cd4907e3a tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:38.307885 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-36c9dd5c-dbd8-4458-8bb8-672cd4907e3a tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:38.308316 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-36c9dd5c-dbd8-4458-8bb8-672cd4907e3a tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:38.475230 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-36c9dd5c-dbd8-4458-8bb8-672cd4907e3a tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:38.482748 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-36c9dd5c-dbd8-4458-8bb8-672cd4907e3a tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724" status: 200 len: 1266 microversion: 2.1 time: 0.187541 Jun 23 22:44:38.483422 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 411/844] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:38 2022] GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:44:38.848698 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-89863514-5b5c-4921-a627-8a397c9b105c tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:38.849360 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-89863514-5b5c-4921-a627-8a397c9b105c tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:38.856374 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-89863514-5b5c-4921-a627-8a397c9b105c tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:38.857112 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-89863514-5b5c-4921-a627-8a397c9b105c tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:38.857884 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-89863514-5b5c-4921-a627-8a397c9b105c tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:38.858542 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-89863514-5b5c-4921-a627-8a397c9b105c tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:38.976837 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d39a3b98-56df-4baa-866b-74c4a0cb1699 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:38.978572 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-d39a3b98-56df-4baa-866b-74c4a0cb1699 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] [instance: 9717199a-93d2-479c-a903-818a5e93b841] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:38.985795 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d39a3b98-56df-4baa-866b-74c4a0cb1699 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:38.986445 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d39a3b98-56df-4baa-866b-74c4a0cb1699 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:38.987645 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d39a3b98-56df-4baa-866b-74c4a0cb1699 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:38.988147 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d39a3b98-56df-4baa-866b-74c4a0cb1699 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:39.138747 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d39a3b98-56df-4baa-866b-74c4a0cb1699 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87b9f9f1adc4c2bb9da82df9d27802e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a0d4c968d84b02977004edf46cde48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:39.147389 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d39a3b98-56df-4baa-866b-74c4a0cb1699 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] 10.222.0.43 "GET /compute/v2.1/servers/9717199a-93d2-479c-a903-818a5e93b841" status: 200 len: 1277 microversion: 2.1 time: 0.176234 Jun 23 22:44:39.147898 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 412/845] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:38 2022] GET /compute/v2.1/servers/9717199a-93d2-479c-a903-818a5e93b841 => generated 1277 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:44:39.320025 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-89863514-5b5c-4921-a627-8a397c9b105c tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:39.327810 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-89863514-5b5c-4921-a627-8a397c9b105c tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1567 microversion: 2.1 time: 0.483879 Jun 23 22:44:39.328378 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 434/846] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:38 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1567 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:44:39.501034 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-ee202646-43ba-4081-814f-b60a71c6355e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:39.502618 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-ee202646-43ba-4081-814f-b60a71c6355e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 60c4a691-2c7d-4621-bfad-17e7a30b5724] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:39.509081 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ee202646-43ba-4081-814f-b60a71c6355e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:39.509617 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ee202646-43ba-4081-814f-b60a71c6355e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:39.510455 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ee202646-43ba-4081-814f-b60a71c6355e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:39.511032 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ee202646-43ba-4081-814f-b60a71c6355e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:39.827391 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [req-0d00a166-877b-4355-81a4-a3211ed0e011 req-2fe4990a-da48-4f38-bca7-0912311a5171 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "628515ea-c2f6-490f-a67d-13d0e97698ac", "name": "network-vif-deleted", "tag": "0b2f39d0-0fe2-4db8-9e32-5112a69d2b21"}]} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:44:39.832948 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ee202646-43ba-4081-814f-b60a71c6355e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:39.841296 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-ee202646-43ba-4081-814f-b60a71c6355e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724" status: 200 len: 1266 microversion: 2.1 time: 0.344965 Jun 23 22:44:39.842535 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 413/847] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:39 2022] GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724 => generated 1266 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:44:39.859177 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-0d00a166-877b-4355-81a4-a3211ed0e011 req-2fe4990a-da48-4f38-bca7-0912311a5171 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:39.863431 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-0d00a166-877b-4355-81a4-a3211ed0e011 req-2fe4990a-da48-4f38-bca7-0912311a5171 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:39.875234 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.compute.server_external_events [req-0d00a166-877b-4355-81a4-a3211ed0e011 req-2fe4990a-da48-4f38-bca7-0912311a5171 service nova] Creating event network-vif-deleted:0b2f39d0-0fe2-4db8-9e32-5112a69d2b21 for instance 628515ea-c2f6-490f-a67d-13d0e97698ac on hv-cinder-84617 Jun 23 22:44:39.881477 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [req-0d00a166-877b-4355-81a4-a3211ed0e011 req-2fe4990a-da48-4f38-bca7-0912311a5171 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058164 Jun 23 22:44:39.882631 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 435/848] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:44:40.166182 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-3beaf9c0-8b83-4108-ae61-346322b1d707 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:40.166903 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-3beaf9c0-8b83-4108-ae61-346322b1d707 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] [instance: 9717199a-93d2-479c-a903-818a5e93b841] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:40.177025 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3beaf9c0-8b83-4108-ae61-346322b1d707 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:40.177832 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3beaf9c0-8b83-4108-ae61-346322b1d707 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:40.178982 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3beaf9c0-8b83-4108-ae61-346322b1d707 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:40.179921 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3beaf9c0-8b83-4108-ae61-346322b1d707 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:40.348346 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-02cd315a-1fed-4fef-b77c-d8fa1b31ac60 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:40.349038 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-02cd315a-1fed-4fef-b77c-d8fa1b31ac60 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:40.355244 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-02cd315a-1fed-4fef-b77c-d8fa1b31ac60 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:40.355678 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-02cd315a-1fed-4fef-b77c-d8fa1b31ac60 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:40.356495 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-02cd315a-1fed-4fef-b77c-d8fa1b31ac60 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:40.356954 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-02cd315a-1fed-4fef-b77c-d8fa1b31ac60 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:40.391432 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-02cd315a-1fed-4fef-b77c-d8fa1b31ac60 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:40.391906 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-02cd315a-1fed-4fef-b77c-d8fa1b31ac60 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:40.392346 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.objects.instance [None req-02cd315a-1fed-4fef-b77c-d8fa1b31ac60 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lazy-loading 'fault' on Instance uuid 628515ea-c2f6-490f-a67d-13d0e97698ac {{(pid=124357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:44:40.459294 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-02cd315a-1fed-4fef-b77c-d8fa1b31ac60 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35838f82371148dda993ca515a1be79c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dceb245422db46eaa1440c39b5755aca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:40.464812 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-3beaf9c0-8b83-4108-ae61-346322b1d707 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87b9f9f1adc4c2bb9da82df9d27802e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a0d4c968d84b02977004edf46cde48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:40.467459 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-02cd315a-1fed-4fef-b77c-d8fa1b31ac60 tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 200 len: 1223 microversion: 2.1 time: 0.124380 Jun 23 22:44:40.468036 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 436/849] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:40 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 1223 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:44:40.479494 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-3beaf9c0-8b83-4108-ae61-346322b1d707 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] 10.222.0.43 "GET /compute/v2.1/servers/9717199a-93d2-479c-a903-818a5e93b841" status: 200 len: 1319 microversion: 2.1 time: 0.317582 Jun 23 22:44:40.480161 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 414/850] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:40 2022] GET /compute/v2.1/servers/9717199a-93d2-479c-a903-818a5e93b841 => generated 1319 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:44:40.701643 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [req-77af580e-c29f-45cb-9f24-fa9ca47eced3 req-fb0166c0-f6f1-47ae-8e27-be381685eb6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60c4a691-2c7d-4621-bfad-17e7a30b5724", "name": "network-vif-plugged", "status": "completed", "tag": "28262990-c9a0-4ed8-bafe-2a4ebcc543dd"}]} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:44:40.710976 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-77af580e-c29f-45cb-9f24-fa9ca47eced3 req-fb0166c0-f6f1-47ae-8e27-be381685eb6c service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:40.711689 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-77af580e-c29f-45cb-9f24-fa9ca47eced3 req-fb0166c0-f6f1-47ae-8e27-be381685eb6c service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:40.726200 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.compute.server_external_events [req-77af580e-c29f-45cb-9f24-fa9ca47eced3 req-fb0166c0-f6f1-47ae-8e27-be381685eb6c service nova] Creating event network-vif-plugged:28262990-c9a0-4ed8-bafe-2a4ebcc543dd for instance 60c4a691-2c7d-4621-bfad-17e7a30b5724 on hv-cinder-84617 Jun 23 22:44:40.731828 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [req-77af580e-c29f-45cb-9f24-fa9ca47eced3 req-fb0166c0-f6f1-47ae-8e27-be381685eb6c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033801 Jun 23 22:44:40.732719 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 437/851] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:44:40.860609 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-0ea18b2c-8791-4524-8321-2ea3e229bb5b tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:40.861211 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-0ea18b2c-8791-4524-8321-2ea3e229bb5b tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 60c4a691-2c7d-4621-bfad-17e7a30b5724] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:40.879494 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0ea18b2c-8791-4524-8321-2ea3e229bb5b tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:40.879937 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0ea18b2c-8791-4524-8321-2ea3e229bb5b tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:40.880708 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0ea18b2c-8791-4524-8321-2ea3e229bb5b tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:40.881132 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0ea18b2c-8791-4524-8321-2ea3e229bb5b tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:41.175343 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-0ea18b2c-8791-4524-8321-2ea3e229bb5b tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:41.183272 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-0ea18b2c-8791-4524-8321-2ea3e229bb5b tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724" status: 200 len: 1266 microversion: 2.1 time: 0.326728 Jun 23 22:44:41.183844 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 415/852] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:40 2022] GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724 => generated 1266 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:44:41.488381 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-a727b85b-ee09-48c9-9d8e-965191c9f7dc tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:41.489112 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-a727b85b-ee09-48c9-9d8e-965191c9f7dc tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] [instance: 628515ea-c2f6-490f-a67d-13d0e97698ac] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:41.495549 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a727b85b-ee09-48c9-9d8e-965191c9f7dc tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:41.495996 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a727b85b-ee09-48c9-9d8e-965191c9f7dc tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:41.496623 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-8a440f7c-4fdd-4eb8-9c5d-155bada524d1 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:41.496759 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a727b85b-ee09-48c9-9d8e-965191c9f7dc tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:41.497176 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a727b85b-ee09-48c9-9d8e-965191c9f7dc tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:41.497607 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-8a440f7c-4fdd-4eb8-9c5d-155bada524d1 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] [instance: 9717199a-93d2-479c-a903-818a5e93b841] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:41.506310 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8a440f7c-4fdd-4eb8-9c5d-155bada524d1 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:41.506751 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8a440f7c-4fdd-4eb8-9c5d-155bada524d1 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:41.507550 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8a440f7c-4fdd-4eb8-9c5d-155bada524d1 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:41.507978 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8a440f7c-4fdd-4eb8-9c5d-155bada524d1 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:41.512986 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.wsgi [None req-a727b85b-ee09-48c9-9d8e-965191c9f7dc tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] HTTP exception thrown: Instance 628515ea-c2f6-490f-a67d-13d0e97698ac could not be found. Jun 23 22:44:41.513868 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-a727b85b-ee09-48c9-9d8e-965191c9f7dc tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Request method failure captured: Jun 23 22:44:41.513868 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: request: GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac HTTP/1.1 Jun 23 22:44:41.513868 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept: application/json Jun 23 22:44:41.513868 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept-Encoding: identity Jun 23 22:44:41.513868 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Connection: close Jun 23 22:44:41.513868 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Length: 0 Jun 23 22:44:41.513868 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Type: application/json Jun 23 22:44:41.513868 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Host: 10.222.0.43 Jun 23 22:44:41.513868 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Openstack-System-Scope: None Jun 23 22:44:41.513868 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: User-Agent: python-urllib3/1.26.9 Jun 23 22:44:41.513868 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Auth-Token: gAAAAABitOuW2ByHcjIMOAFUWveiU-iHP6MUDKaM2fnMKQBy13onjpRR5mTQpl_EVD-q8MmXyTLvKuV43I3ZDDK8yxnxLR_yGDJwc9jqOKwau6oJvrAOJ3SufRoczqUffgcSFsf8WDlgzl_w5f8zerJeN0iB9YcqoyIgkiHeZcm74x5swjng3r0 Jun 23 22:44:41.513868 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Id: None Jun 23 22:44:41.513868 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Name: None Jun 23 22:44:41.513868 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Identity-Status: Confirmed Jun 23 22:44:41.513868 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Is-Admin-Project: True Jun 23 22:44:41.513868 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Id: default Jun 23 22:44:41.513868 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Name: Default Jun 23 22:44:41.513868 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Id: dceb245422db46eaa1440c39b5755aca Jun 23 22:44:41.513868 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Name: tempest-TestShelveInstance-1294550664 Jun 23 22:44:41.513868 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Role: reader,member Jun 23 22:44:41.513868 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Roles: reader,member Jun 23 22:44:41.515378 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dceb245422db46eaa1440c39b5755aca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/dceb245422db46eaa1440c39b5755aca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_dceb245422db46eaa1440c39b5755aca", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/dceb245422db46eaa1440c39b5755aca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:44:41.515378 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant: tempest-TestShelveInstance-1294550664 Jun 23 22:44:41.515378 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Id: dceb245422db46eaa1440c39b5755aca Jun 23 22:44:41.515378 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Name: tempest-TestShelveInstance-1294550664 Jun 23 22:44:41.515378 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User: tempest-TestShelveInstance-1294550664-project Jun 23 22:44:41.515378 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Id: default Jun 23 22:44:41.515378 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Name: Default Jun 23 22:44:41.515378 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Id: 35838f82371148dda993ca515a1be79c Jun 23 22:44:41.515378 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Name: tempest-TestShelveInstance-1294550664-project Jun 23 22:44:41.515378 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: method: > Jun 23 22:44:41.515378 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: exception: Instance 628515ea-c2f6-490f-a67d-13d0e97698ac could not be found. Jun 23 22:44:41.515378 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: action_args: {'id': '628515ea-c2f6-490f-a67d-13d0e97698ac'} Jun 23 22:44:41.516252 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:44:41.516252 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:44:41.516252 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:44:41.516252 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:44:41.516252 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:44:41.516252 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:44:41.516252 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:44:41.516252 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:44:41.516252 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:44:41.516252 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:44:41.516252 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 628515ea-c2f6-490f-a67d-13d0e97698ac could not be found. Jun 23 22:44:41.516252 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:44:41.516252 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:44:41.516252 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:44:41.516252 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:44:41.516252 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:44:41.516252 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:44:41.516252 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:44:41.516252 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:44:41.516252 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:44:41.517576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:44:41.517576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:44:41.517576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:44:41.517576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:44:41.517576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:44:41.517576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:44:41.517576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:44:41.517576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 628515ea-c2f6-490f-a67d-13d0e97698ac could not be found. Jun 23 22:44:41.517576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:44:41.517576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:44:41.517576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:44:41.517576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:44:41.517576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:44:41.517576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:44:41.517576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:44:41.517576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:44:41.517576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 628515ea-c2f6-490f-a67d-13d0e97698ac could not be found. Jun 23 22:44:41.517576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:44:41.518812 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-a727b85b-ee09-48c9-9d8e-965191c9f7dc tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Returning 404 to user: Instance 628515ea-c2f6-490f-a67d-13d0e97698ac could not be found. {{(pid=124357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:44:41.518812 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-a727b85b-ee09-48c9-9d8e-965191c9f7dc tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac" status: 404 len: 111 microversion: 2.1 time: 0.032186 Jun 23 22:44:41.518812 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 438/853] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:41 2022] GET /compute/v2.1/servers/628515ea-c2f6-490f-a67d-13d0e97698ac => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:44:41.694125 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-678dd72e-dd6c-4903-81d0-72c093c0552e tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] Calling method '.version_select at 0x7fb71961b550>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:41.712250 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-8a440f7c-4fdd-4eb8-9c5d-155bada524d1 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87b9f9f1adc4c2bb9da82df9d27802e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a0d4c968d84b02977004edf46cde48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:41.712764 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-678dd72e-dd6c-4903-81d0-72c093c0552e tempest-TestShelveInstance-1294550664 tempest-TestShelveInstance-1294550664-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-162414453" status: 202 len: 0 microversion: 2.1 time: 0.022817 Jun 23 22:44:41.713346 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 439/854] 10.222.0.43 () {58 vars in 1250 bytes} [Thu Jun 23 22:44:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-162414453 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 22:44:41.726318 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-8a440f7c-4fdd-4eb8-9c5d-155bada524d1 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] 10.222.0.43 "GET /compute/v2.1/servers/9717199a-93d2-479c-a903-818a5e93b841" status: 200 len: 1319 microversion: 2.1 time: 0.233433 Jun 23 22:44:41.727143 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 416/855] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:41 2022] GET /compute/v2.1/servers/9717199a-93d2-479c-a903-818a5e93b841 => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:44:42.138903 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [req-dec969f5-538b-4e8f-b622-95d116741e23 req-b3b070d6-f696-4fcd-bf0c-4e9aa5f9651e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9717199a-93d2-479c-a903-818a5e93b841", "tag": "e63211d3-926c-49a4-9403-d08483acf737"}]} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:44:42.148927 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-dec969f5-538b-4e8f-b622-95d116741e23 req-b3b070d6-f696-4fcd-bf0c-4e9aa5f9651e service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:42.149839 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-dec969f5-538b-4e8f-b622-95d116741e23 req-b3b070d6-f696-4fcd-bf0c-4e9aa5f9651e service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:42.162177 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.compute.server_external_events [req-dec969f5-538b-4e8f-b622-95d116741e23 req-b3b070d6-f696-4fcd-bf0c-4e9aa5f9651e service nova] Creating event network-changed:e63211d3-926c-49a4-9403-d08483acf737 for instance 9717199a-93d2-479c-a903-818a5e93b841 on hv-cinder-84617 Jun 23 22:44:42.167465 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [req-dec969f5-538b-4e8f-b622-95d116741e23 req-b3b070d6-f696-4fcd-bf0c-4e9aa5f9651e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032253 Jun 23 22:44:42.168987 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 440/856] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:44:42.200877 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-77703c8b-09ab-4d7c-88b1-5e4e6d7cd433 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:42.201491 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-77703c8b-09ab-4d7c-88b1-5e4e6d7cd433 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 60c4a691-2c7d-4621-bfad-17e7a30b5724] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:42.209001 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-77703c8b-09ab-4d7c-88b1-5e4e6d7cd433 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:42.209443 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-77703c8b-09ab-4d7c-88b1-5e4e6d7cd433 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:42.217562 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-77703c8b-09ab-4d7c-88b1-5e4e6d7cd433 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:42.218280 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-77703c8b-09ab-4d7c-88b1-5e4e6d7cd433 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:42.437470 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-77703c8b-09ab-4d7c-88b1-5e4e6d7cd433 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:42.445920 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-77703c8b-09ab-4d7c-88b1-5e4e6d7cd433 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724" status: 200 len: 1266 microversion: 2.1 time: 0.248926 Jun 23 22:44:42.446499 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 417/857] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:42 2022] GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724 => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:44:42.746534 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-aadf9582-f9dd-4e06-98a9-558f39d39f9a tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:42.747278 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-aadf9582-f9dd-4e06-98a9-558f39d39f9a tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] [instance: 9717199a-93d2-479c-a903-818a5e93b841] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:42.754035 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-aadf9582-f9dd-4e06-98a9-558f39d39f9a tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:42.754623 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-aadf9582-f9dd-4e06-98a9-558f39d39f9a tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:42.755242 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-aadf9582-f9dd-4e06-98a9-558f39d39f9a tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:42.755665 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-aadf9582-f9dd-4e06-98a9-558f39d39f9a tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:42.958747 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-aadf9582-f9dd-4e06-98a9-558f39d39f9a tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87b9f9f1adc4c2bb9da82df9d27802e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a0d4c968d84b02977004edf46cde48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:42.966742 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-aadf9582-f9dd-4e06-98a9-558f39d39f9a tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] 10.222.0.43 "GET /compute/v2.1/servers/9717199a-93d2-479c-a903-818a5e93b841" status: 200 len: 1319 microversion: 2.1 time: 0.224879 Jun 23 22:44:42.967332 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 441/858] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:42 2022] GET /compute/v2.1/servers/9717199a-93d2-479c-a903-818a5e93b841 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:44:43.463068 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-95108567-f26c-44cb-83be-6a70cc6b24df tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:43.463680 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-95108567-f26c-44cb-83be-6a70cc6b24df tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 60c4a691-2c7d-4621-bfad-17e7a30b5724] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:43.472749 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-95108567-f26c-44cb-83be-6a70cc6b24df tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:43.473190 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-95108567-f26c-44cb-83be-6a70cc6b24df tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:43.473958 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-95108567-f26c-44cb-83be-6a70cc6b24df tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:43.474408 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-95108567-f26c-44cb-83be-6a70cc6b24df tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:43.478735 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=100 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:44:43.944585 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-95108567-f26c-44cb-83be-6a70cc6b24df tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:43.954663 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-95108567-f26c-44cb-83be-6a70cc6b24df tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724" status: 200 len: 1453 microversion: 2.1 time: 0.495464 Jun 23 22:44:43.966674 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 418/859] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:43 2022] GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724 => generated 1453 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:44:43.972454 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-cb57b914-2b71-41a2-a049-323daee095cd tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:43.973160 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-cb57b914-2b71-41a2-a049-323daee095cd tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 60c4a691-2c7d-4621-bfad-17e7a30b5724] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:43.985265 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-0c4c622e-38e8-4236-99e0-6e25a137e5dc tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:43.985876 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-0c4c622e-38e8-4236-99e0-6e25a137e5dc tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] [instance: 9717199a-93d2-479c-a903-818a5e93b841] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:43.989439 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-cb57b914-2b71-41a2-a049-323daee095cd tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:43.989884 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-cb57b914-2b71-41a2-a049-323daee095cd tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:43.990776 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-cb57b914-2b71-41a2-a049-323daee095cd tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:43.991236 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-cb57b914-2b71-41a2-a049-323daee095cd tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:44.000149 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0c4c622e-38e8-4236-99e0-6e25a137e5dc tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:44.000591 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0c4c622e-38e8-4236-99e0-6e25a137e5dc tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:44.001362 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0c4c622e-38e8-4236-99e0-6e25a137e5dc tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:44.001787 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0c4c622e-38e8-4236-99e0-6e25a137e5dc tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:44.406645 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-0c4c622e-38e8-4236-99e0-6e25a137e5dc tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87b9f9f1adc4c2bb9da82df9d27802e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a0d4c968d84b02977004edf46cde48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:44.414461 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-0c4c622e-38e8-4236-99e0-6e25a137e5dc tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] 10.222.0.43 "GET /compute/v2.1/servers/9717199a-93d2-479c-a903-818a5e93b841" status: 200 len: 1319 microversion: 2.1 time: 0.435008 Jun 23 22:44:44.415051 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 419/860] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:43 2022] GET /compute/v2.1/servers/9717199a-93d2-479c-a903-818a5e93b841 => generated 1319 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:44:44.419331 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-cb57b914-2b71-41a2-a049-323daee095cd tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:44.427545 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-cb57b914-2b71-41a2-a049-323daee095cd tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724" status: 200 len: 1453 microversion: 2.1 time: 0.459438 Jun 23 22:44:44.428125 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 442/861] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:43 2022] GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724 => generated 1453 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:44:45.431901 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a8f284ff-65bf-4e1f-9c0d-ce99680ee744 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:45.433117 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-a8f284ff-65bf-4e1f-9c0d-ce99680ee744 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] [instance: 9717199a-93d2-479c-a903-818a5e93b841] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:45.441933 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a8f284ff-65bf-4e1f-9c0d-ce99680ee744 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:45.442476 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a8f284ff-65bf-4e1f-9c0d-ce99680ee744 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:45.443417 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a8f284ff-65bf-4e1f-9c0d-ce99680ee744 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:45.444135 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a8f284ff-65bf-4e1f-9c0d-ce99680ee744 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:45.596141 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=2 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:44:45.618066 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=6 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:44:45.712969 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-a8f284ff-65bf-4e1f-9c0d-ce99680ee744 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87b9f9f1adc4c2bb9da82df9d27802e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a0d4c968d84b02977004edf46cde48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:45.724423 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-a8f284ff-65bf-4e1f-9c0d-ce99680ee744 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] 10.222.0.43 "GET /compute/v2.1/servers/9717199a-93d2-479c-a903-818a5e93b841" status: 200 len: 1319 microversion: 2.1 time: 0.296617 Jun 23 22:44:45.726310 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 420/862] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:45 2022] GET /compute/v2.1/servers/9717199a-93d2-479c-a903-818a5e93b841 => generated 1319 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:44:46.742859 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-9df6ba66-0d66-4ab4-8e1d-739fd00d6c20 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:46.744337 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-9df6ba66-0d66-4ab4-8e1d-739fd00d6c20 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] [instance: 9717199a-93d2-479c-a903-818a5e93b841] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:46.746891 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell0:SELECT=2 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:44:46.753838 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9df6ba66-0d66-4ab4-8e1d-739fd00d6c20 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:46.754489 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9df6ba66-0d66-4ab4-8e1d-739fd00d6c20 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:46.755150 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9df6ba66-0d66-4ab4-8e1d-739fd00d6c20 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:46.756516 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9df6ba66-0d66-4ab4-8e1d-739fd00d6c20 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:46.765769 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-cfb61192-6c30-4ed1-971f-30afec06d751 req-e5c07b24-76b6-4966-b2d3-d440dab1768c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9717199a-93d2-479c-a903-818a5e93b841", "name": "network-vif-plugged", "status": "completed", "tag": "e63211d3-926c-49a4-9403-d08483acf737"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:44:46.785923 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-cfb61192-6c30-4ed1-971f-30afec06d751 req-e5c07b24-76b6-4966-b2d3-d440dab1768c service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:46.786835 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-cfb61192-6c30-4ed1-971f-30afec06d751 req-e5c07b24-76b6-4966-b2d3-d440dab1768c service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:46.809027 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-cfb61192-6c30-4ed1-971f-30afec06d751 req-e5c07b24-76b6-4966-b2d3-d440dab1768c service nova] Creating event network-vif-plugged:e63211d3-926c-49a4-9403-d08483acf737 for instance 9717199a-93d2-479c-a903-818a5e93b841 on hv-cinder-84617 Jun 23 22:44:46.817394 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-cfb61192-6c30-4ed1-971f-30afec06d751 req-e5c07b24-76b6-4966-b2d3-d440dab1768c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057940 Jun 23 22:44:46.818571 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 421/863] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:44:46.881211 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-fb5ab70c-19c2-4c40-a21d-80796471e59b req-fde10e69-d3d1-453d-877d-04a02e8175d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60c4a691-2c7d-4621-bfad-17e7a30b5724", "tag": "28262990-c9a0-4ed8-bafe-2a4ebcc543dd"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:44:46.892527 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-fb5ab70c-19c2-4c40-a21d-80796471e59b req-fde10e69-d3d1-453d-877d-04a02e8175d8 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:46.893094 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-fb5ab70c-19c2-4c40-a21d-80796471e59b req-fde10e69-d3d1-453d-877d-04a02e8175d8 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:46.906278 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-fb5ab70c-19c2-4c40-a21d-80796471e59b req-fde10e69-d3d1-453d-877d-04a02e8175d8 service nova] Creating event network-changed:28262990-c9a0-4ed8-bafe-2a4ebcc543dd for instance 60c4a691-2c7d-4621-bfad-17e7a30b5724 on hv-cinder-84617 Jun 23 22:44:46.912458 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-fb5ab70c-19c2-4c40-a21d-80796471e59b req-fde10e69-d3d1-453d-877d-04a02e8175d8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040520 Jun 23 22:44:46.913411 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 422/864] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:44:47.090829 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-9df6ba66-0d66-4ab4-8e1d-739fd00d6c20 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87b9f9f1adc4c2bb9da82df9d27802e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a0d4c968d84b02977004edf46cde48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:47.102692 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-9df6ba66-0d66-4ab4-8e1d-739fd00d6c20 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] 10.222.0.43 "GET /compute/v2.1/servers/9717199a-93d2-479c-a903-818a5e93b841" status: 200 len: 1319 microversion: 2.1 time: 0.363731 Jun 23 22:44:47.104000 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 443/865] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:46 2022] GET /compute/v2.1/servers/9717199a-93d2-479c-a903-818a5e93b841 => generated 1319 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:44:48.122845 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-b8dc8f77-12a6-43e0-8cee-34c34b15534b tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:48.124264 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-b8dc8f77-12a6-43e0-8cee-34c34b15534b tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] [instance: 9717199a-93d2-479c-a903-818a5e93b841] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:48.136089 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b8dc8f77-12a6-43e0-8cee-34c34b15534b tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:48.136528 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b8dc8f77-12a6-43e0-8cee-34c34b15534b tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:48.137330 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b8dc8f77-12a6-43e0-8cee-34c34b15534b tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:48.137774 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-b8dc8f77-12a6-43e0-8cee-34c34b15534b tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:48.366788 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-b8dc8f77-12a6-43e0-8cee-34c34b15534b tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87b9f9f1adc4c2bb9da82df9d27802e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a0d4c968d84b02977004edf46cde48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:48.375732 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-b8dc8f77-12a6-43e0-8cee-34c34b15534b tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] 10.222.0.43 "GET /compute/v2.1/servers/9717199a-93d2-479c-a903-818a5e93b841" status: 200 len: 1319 microversion: 2.1 time: 0.258943 Jun 23 22:44:48.376302 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 423/866] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:48 2022] GET /compute/v2.1/servers/9717199a-93d2-479c-a903-818a5e93b841 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:44:49.392863 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-706f1def-f0fc-4a2f-9363-6f8e9132457f tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:49.394281 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-706f1def-f0fc-4a2f-9363-6f8e9132457f tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] [instance: 9717199a-93d2-479c-a903-818a5e93b841] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:49.408885 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-706f1def-f0fc-4a2f-9363-6f8e9132457f tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:49.409452 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-706f1def-f0fc-4a2f-9363-6f8e9132457f tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:49.410239 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-706f1def-f0fc-4a2f-9363-6f8e9132457f tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:49.410843 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-706f1def-f0fc-4a2f-9363-6f8e9132457f tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:49.632208 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-706f1def-f0fc-4a2f-9363-6f8e9132457f tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87b9f9f1adc4c2bb9da82df9d27802e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a0d4c968d84b02977004edf46cde48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:44:49.647903 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-706f1def-f0fc-4a2f-9363-6f8e9132457f tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] 10.222.0.43 "GET /compute/v2.1/servers/9717199a-93d2-479c-a903-818a5e93b841" status: 200 len: 1508 microversion: 2.1 time: 0.258834 Jun 23 22:44:49.660316 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 444/867] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:44:49 2022] GET /compute/v2.1/servers/9717199a-93d2-479c-a903-818a5e93b841 => generated 1508 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:44:58.616309 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-95fe3218-9f55-4877-a0cb-434bb169ce6a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:58.616843 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-95fe3218-9f55-4877-a0cb-434bb169ce6a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:58.619081 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:44:58.619722 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=27 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:44:58.627787 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-95fe3218-9f55-4877-a0cb-434bb169ce6a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:58.628233 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-95fe3218-9f55-4877-a0cb-434bb169ce6a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:58.629112 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-95fe3218-9f55-4877-a0cb-434bb169ce6a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:58.629537 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-95fe3218-9f55-4877-a0cb-434bb169ce6a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:58.658806 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-95fe3218-9f55-4877-a0cb-434bb169ce6a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3/os-volume_attachments/f02a5d89-9ed2-4014-a0ce-f605496399ce" status: 200 len: 194 microversion: 2.20 time: 0.046947 Jun 23 22:44:58.659414 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 424/868] 10.222.0.43 () {60 vars in 1453 bytes} [Thu Jun 23 22:44:58 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3/os-volume_attachments/f02a5d89-9ed2-4014-a0ce-f605496399ce => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 22:44:58.723606 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-f00d0598-b5d9-4582-ad90-b57d99353d02 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:58.724110 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-f00d0598-b5d9-4582-ad90-b57d99353d02 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:58.730326 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f00d0598-b5d9-4582-ad90-b57d99353d02 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:58.730769 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f00d0598-b5d9-4582-ad90-b57d99353d02 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:58.731616 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f00d0598-b5d9-4582-ad90-b57d99353d02 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:58.731993 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f00d0598-b5d9-4582-ad90-b57d99353d02 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:58.816749 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.objects.instance [None req-f00d0598-b5d9-4582-ad90-b57d99353d02 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lazy-loading 'services' on Instance uuid 7b2f6937-650f-42b2-83cb-f2f54c40a6b3 {{(pid=124357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:44:58.891664 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-f00d0598-b5d9-4582-ad90-b57d99353d02 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3/os-volume_attachments/f02a5d89-9ed2-4014-a0ce-f605496399ce" status: 202 len: 0 microversion: 2.20 time: 0.172407 Jun 23 22:44:58.892250 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 445/869] 10.222.0.43 () {60 vars in 1456 bytes} [Thu Jun 23 22:44:58 2022] DELETE /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3/os-volume_attachments/f02a5d89-9ed2-4014-a0ce-f605496399ce => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 23 22:44:58.900896 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a099961d-0ae8-40f2-917f-6ae0bd6ada9d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:58.902481 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-a099961d-0ae8-40f2-917f-6ae0bd6ada9d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:58.909965 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a099961d-0ae8-40f2-917f-6ae0bd6ada9d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:58.910414 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a099961d-0ae8-40f2-917f-6ae0bd6ada9d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:58.911309 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a099961d-0ae8-40f2-917f-6ae0bd6ada9d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:58.911906 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a099961d-0ae8-40f2-917f-6ae0bd6ada9d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:58.945660 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-a099961d-0ae8-40f2-917f-6ae0bd6ada9d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048653 Jun 23 22:44:58.946233 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 425/870] 10.222.0.43 () {60 vars in 1342 bytes} [Thu Jun 23 22:44:58 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 22:44:59.959244 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-217f241f-8c01-4bd7-8664-9d4715c50895 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:44:59.960533 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-217f241f-8c01-4bd7-8664-9d4715c50895 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:44:59.971255 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-217f241f-8c01-4bd7-8664-9d4715c50895 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:59.971777 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-217f241f-8c01-4bd7-8664-9d4715c50895 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:59.972478 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-217f241f-8c01-4bd7-8664-9d4715c50895 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:59.972911 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-217f241f-8c01-4bd7-8664-9d4715c50895 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:00.006658 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:45:00.013953 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-217f241f-8c01-4bd7-8664-9d4715c50895 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.059392 Jun 23 22:45:00.014544 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 446/871] 10.222.0.43 () {60 vars in 1342 bytes} [Thu Jun 23 22:44:59 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:00.089056 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-24bf0747-d3cd-42c7-ae6b-ce0705ffb0e3 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:00.090194 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-24bf0747-d3cd-42c7-ae6b-ce0705ffb0e3 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:00.098766 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-24bf0747-d3cd-42c7-ae6b-ce0705ffb0e3 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:00.099268 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-24bf0747-d3cd-42c7-ae6b-ce0705ffb0e3 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:00.100044 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-24bf0747-d3cd-42c7-ae6b-ce0705ffb0e3 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:00.100479 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-24bf0747-d3cd-42c7-ae6b-ce0705ffb0e3 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:00.140988 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-24bf0747-d3cd-42c7-ae6b-ce0705ffb0e3 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Going to try to terminate instance {{(pid=124358) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:45:00.229244 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-24bf0747-d3cd-42c7-ae6b-ce0705ffb0e3 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 204 len: 0 microversion: 2.20 time: 0.143950 Jun 23 22:45:00.229863 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 426/872] 10.222.0.43 () {60 vars in 1279 bytes} [Thu Jun 23 22:45:00 2022] DELETE /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 23 22:45:00.240622 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-9b9d786e-d0c6-40df-a0f4-1e84c2baec58 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:00.241498 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-9b9d786e-d0c6-40df-a0f4-1e84c2baec58 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:00.251764 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9b9d786e-d0c6-40df-a0f4-1e84c2baec58 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:00.252897 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9b9d786e-d0c6-40df-a0f4-1e84c2baec58 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:00.253765 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9b9d786e-d0c6-40df-a0f4-1e84c2baec58 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:00.254296 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9b9d786e-d0c6-40df-a0f4-1e84c2baec58 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:00.397031 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-9b9d786e-d0c6-40df-a0f4-1e84c2baec58 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:00.404869 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-9b9d786e-d0c6-40df-a0f4-1e84c2baec58 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:00.406368 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-9b9d786e-d0c6-40df-a0f4-1e84c2baec58 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:00.407606 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-9b9d786e-d0c6-40df-a0f4-1e84c2baec58 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1724 microversion: 2.20 time: 0.173213 Jun 23 22:45:00.408162 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 447/873] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:45:00 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:45:01.429434 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-337859b1-0557-41c5-a31b-38302d63d938 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:01.430248 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-337859b1-0557-41c5-a31b-38302d63d938 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:01.436684 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-337859b1-0557-41c5-a31b-38302d63d938 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:01.437127 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-337859b1-0557-41c5-a31b-38302d63d938 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:01.437886 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-337859b1-0557-41c5-a31b-38302d63d938 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:01.438312 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-337859b1-0557-41c5-a31b-38302d63d938 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:01.576001 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-337859b1-0557-41c5-a31b-38302d63d938 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:01.584141 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-337859b1-0557-41c5-a31b-38302d63d938 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:01.585678 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-337859b1-0557-41c5-a31b-38302d63d938 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:01.586897 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-337859b1-0557-41c5-a31b-38302d63d938 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1724 microversion: 2.20 time: 0.162865 Jun 23 22:45:01.587494 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 427/874] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:45:01 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:45:02.605822 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-8619f30b-ae41-4167-85c7-228c6fb31906 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:02.606552 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-8619f30b-ae41-4167-85c7-228c6fb31906 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:02.613047 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-8619f30b-ae41-4167-85c7-228c6fb31906 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:02.613491 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-8619f30b-ae41-4167-85c7-228c6fb31906 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:02.614867 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-8619f30b-ae41-4167-85c7-228c6fb31906 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:02.615350 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-8619f30b-ae41-4167-85c7-228c6fb31906 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:02.831449 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-8619f30b-ae41-4167-85c7-228c6fb31906 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:02.839353 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-8619f30b-ae41-4167-85c7-228c6fb31906 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:02.840845 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-8619f30b-ae41-4167-85c7-228c6fb31906 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:02.842013 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-8619f30b-ae41-4167-85c7-228c6fb31906 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1724 microversion: 2.20 time: 0.240167 Jun 23 22:45:02.842569 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 448/875] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:45:02 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:45:03.763776 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-ff2841ed-747d-4e25-af4e-a715e7499e28 req-a2a128c1-5221-4e3c-8aae-333976b81a6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b2f6937-650f-42b2-83cb-f2f54c40a6b3", "name": "network-vif-deleted", "tag": "25e676fe-9948-4de4-91ae-b15fb391a86c"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:45:03.775678 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-ff2841ed-747d-4e25-af4e-a715e7499e28 req-a2a128c1-5221-4e3c-8aae-333976b81a6f service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:03.776265 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-ff2841ed-747d-4e25-af4e-a715e7499e28 req-a2a128c1-5221-4e3c-8aae-333976b81a6f service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:03.788590 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-ff2841ed-747d-4e25-af4e-a715e7499e28 req-a2a128c1-5221-4e3c-8aae-333976b81a6f service nova] Creating event network-vif-deleted:25e676fe-9948-4de4-91ae-b15fb391a86c for instance 7b2f6937-650f-42b2-83cb-f2f54c40a6b3 on hv-cinder-84617 Jun 23 22:45:03.799342 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-ff2841ed-747d-4e25-af4e-a715e7499e28 req-a2a128c1-5221-4e3c-8aae-333976b81a6f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039074 Jun 23 22:45:03.799876 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 428/876] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:45:03.862939 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-fcd9e6b4-3039-4146-9499-7db034411da2 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:03.865005 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-fcd9e6b4-3039-4146-9499-7db034411da2 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:03.872492 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fcd9e6b4-3039-4146-9499-7db034411da2 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:03.872929 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fcd9e6b4-3039-4146-9499-7db034411da2 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:03.873702 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fcd9e6b4-3039-4146-9499-7db034411da2 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:03.874136 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fcd9e6b4-3039-4146-9499-7db034411da2 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:03.921012 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fcd9e6b4-3039-4146-9499-7db034411da2 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:03.921461 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fcd9e6b4-3039-4146-9499-7db034411da2 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:03.921914 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.objects.instance [None req-fcd9e6b4-3039-4146-9499-7db034411da2 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lazy-loading 'fault' on Instance uuid 7b2f6937-650f-42b2-83cb-f2f54c40a6b3 {{(pid=124357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:45:03.968561 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-fcd9e6b4-3039-4146-9499-7db034411da2 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:03.977326 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-fcd9e6b4-3039-4146-9499-7db034411da2 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:03.978992 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-fcd9e6b4-3039-4146-9499-7db034411da2 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:03.980182 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-fcd9e6b4-3039-4146-9499-7db034411da2 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 200 len: 1372 microversion: 2.20 time: 0.122431 Jun 23 22:45:03.980744 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 449/877] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:45:03 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 1372 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:45:05.000091 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-93f14585-2403-497d-aab4-814f654bca97 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:05.000795 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-93f14585-2403-497d-aab4-814f654bca97 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:05.007714 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-93f14585-2403-497d-aab4-814f654bca97 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:05.008161 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-93f14585-2403-497d-aab4-814f654bca97 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:05.008923 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-93f14585-2403-497d-aab4-814f654bca97 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:05.009357 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-93f14585-2403-497d-aab4-814f654bca97 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:05.022950 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-93f14585-2403-497d-aab4-814f654bca97 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] HTTP exception thrown: Instance 7b2f6937-650f-42b2-83cb-f2f54c40a6b3 could not be found. Jun 23 22:45:05.024561 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-93f14585-2403-497d-aab4-814f654bca97 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Request method failure captured: Jun 23 22:45:05.024561 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: request: GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 HTTP/1.1 Jun 23 22:45:05.024561 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept: application/json Jun 23 22:45:05.024561 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Jun 23 22:45:05.024561 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Connection: close Jun 23 22:45:05.024561 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Length: 0 Jun 23 22:45:05.024561 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Type: application/json Jun 23 22:45:05.024561 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Host: 10.222.0.43 Jun 23 22:45:05.024561 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Jun 23 22:45:05.024561 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.9 Jun 23 22:45:05.024561 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABitOw0MOa6BWaAt76FiQb8wWjlkd6hLuW8KhNVqtFEeH7Vws1c7QV4QlDvvx1Ug-8Yn5zV2V6vcx0uASju7DUTyb3QJ1o8IVd5RMaIPwt_Hv-mRoZHqYWgBD-pTirG_gG7jFYX5SE0xzTE7P_w_QLEw6Zoh8UwLtYv-hyiNcCSTo9V-bM Jun 23 22:45:05.024561 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Jun 23 22:45:05.024561 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Jun 23 22:45:05.024561 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Jun 23 22:45:05.024561 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Jun 23 22:45:05.024561 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 22:45:05.024561 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Jun 23 22:45:05.024561 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Jun 23 22:45:05.024561 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Id: 9ab3a2e6c9634a06b33f1d82a28dc3f1 Jun 23 22:45:05.024561 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-543397818 Jun 23 22:45:05.024561 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Role: reader,member Jun 23 22:45:05.024561 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Roles: reader,member Jun 23 22:45:05.027439 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9ab3a2e6c9634a06b33f1d82a28dc3f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9ab3a2e6c9634a06b33f1d82a28dc3f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9ab3a2e6c9634a06b33f1d82a28dc3f1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9ab3a2e6c9634a06b33f1d82a28dc3f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:45:05.027439 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-AttachVolumeShelveTestJSON-543397818 Jun 23 22:45:05.027439 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Id: 9ab3a2e6c9634a06b33f1d82a28dc3f1 Jun 23 22:45:05.027439 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-543397818 Jun 23 22:45:05.027439 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User: tempest-AttachVolumeShelveTestJSON-543397818-project Jun 23 22:45:05.027439 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Jun 23 22:45:05.027439 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Jun 23 22:45:05.027439 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Id: 1a93ea9f0a3f47d68e53c464c1d52c92 Jun 23 22:45:05.027439 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-AttachVolumeShelveTestJSON-543397818-project Jun 23 22:45:05.027439 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: method: > Jun 23 22:45:05.027439 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: exception: Instance 7b2f6937-650f-42b2-83cb-f2f54c40a6b3 could not be found. Jun 23 22:45:05.027439 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: action_args: {'id': '7b2f6937-650f-42b2-83cb-f2f54c40a6b3'} Jun 23 22:45:05.029272 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:45:05.029272 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:45:05.029272 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:45:05.029272 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:45:05.029272 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:45:05.029272 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:45:05.029272 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:45:05.029272 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:45:05.029272 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:45:05.029272 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:45:05.029272 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b2f6937-650f-42b2-83cb-f2f54c40a6b3 could not be found. Jun 23 22:45:05.029272 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:45:05.029272 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:45:05.029272 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:45:05.029272 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:45:05.029272 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:45:05.029272 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:45:05.029272 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:45:05.029272 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:45:05.029272 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:45:05.032346 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:45:05.032346 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:45:05.032346 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:45:05.032346 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:45:05.032346 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:45:05.032346 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:45:05.032346 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:45:05.032346 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b2f6937-650f-42b2-83cb-f2f54c40a6b3 could not be found. Jun 23 22:45:05.032346 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:45:05.032346 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:45:05.032346 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:45:05.032346 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:45:05.032346 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:45:05.032346 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:45:05.032346 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:45:05.032346 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:45:05.032346 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b2f6937-650f-42b2-83cb-f2f54c40a6b3 could not be found. Jun 23 22:45:05.032346 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:45:05.035131 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-93f14585-2403-497d-aab4-814f654bca97 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Returning 404 to user: Instance 7b2f6937-650f-42b2-83cb-f2f54c40a6b3 could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:45:05.035131 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-93f14585-2403-497d-aab4-814f654bca97 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 404 len: 111 microversion: 2.20 time: 0.030654 Jun 23 22:45:05.035131 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 429/878] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:45:04 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 22:45:05.038081 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-4c22b412-2575-4db0-b707-acb8d6b78fa2 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '.version_select at 0x7fb71955ab80>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:05.043950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:45:05.057370 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-4c22b412-2575-4db0-b707-acb8d6b78fa2 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1318055940" status: 204 len: 0 microversion: 2.20 time: 0.024397 Jun 23 22:45:05.057858 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 450/879] 10.222.0.43 () {60 vars in 1261 bytes} [Thu Jun 23 22:45:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1318055940 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 23 22:45:05.697234 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-4004560f-27ed-44a2-a0a7-53ec6477e640 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Action: 'create', calling method: .version_select at 0x7fb719650ca0>, body: {"keypair": {"name": "tempest-keypair-1541421143", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3bi/ZaTTtZAX4kufo3Mu3j7jsJEXcpZnFki/ow6tllFz0kKJCPFSktEcQd6wY3RxPTWH3AUe00Wd3LnbMKL/1y/PW8Sujx698K+m0oa4uPYu9LkX06y69y0XLYnBIhVg=="}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:45:05.711174 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-4004560f-27ed-44a2-a0a7-53ec6477e640 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Getting quotas for project 9ab3a2e6c9634a06b33f1d82a28dc3f1. Resources: {'key_pairs'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:45:05.715068 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-4004560f-27ed-44a2-a0a7-53ec6477e640 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Getting quotas for user 1a93ea9f0a3f47d68e53c464c1d52c92 and project 9ab3a2e6c9634a06b33f1d82a28dc3f1. Resources: {'key_pairs'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:45:05.736851 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-4004560f-27ed-44a2-a0a7-53ec6477e640 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.043948 Jun 23 22:45:05.737465 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 430/880] 10.222.0.43 () {62 vars in 1199 bytes} [Thu Jun 23 22:45:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 45 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 23 22:45:07.208287 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-45ec8224-cc19-4277-ab3c-44128ddf41fe tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-889575807", "imageRef": "ac7d441e-2ac8-49ad-9dc5-3c55bd4b4f8b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c8ffa52a-0ee3-4aa1-92ba-211a08d60da3"}], "security_groups": [{"name": "tempest-securitygroup--1372670826"}], "key_name": "tempest-keypair-1541421143", "user_data": "}} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:45:07.345488 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.network.neutron [None req-45ec8224-cc19-4277-ab3c-44128ddf41fe tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] validate_networks() for [('c8ffa52a-0ee3-4aa1-92ba-211a08d60da3', None, None, None, None, None)] {{(pid=124357) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:45:07.781863 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-45ec8224-cc19-4277-ab3c-44128ddf41fe tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Flavor limits 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:45:07.782290 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-45ec8224-cc19-4277-ab3c-44128ddf41fe tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Image limits 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:45:07.782799 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-45ec8224-cc19-4277-ab3c-44128ddf41fe tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Flavor pref 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:45:07.783249 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-45ec8224-cc19-4277-ab3c-44128ddf41fe tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Image pref 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:45:07.783667 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-45ec8224-cc19-4277-ab3c-44128ddf41fe tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:45:07.792481 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-45ec8224-cc19-4277-ab3c-44128ddf41fe tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:07.792930 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-45ec8224-cc19-4277-ab3c-44128ddf41fe tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:07.793978 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-45ec8224-cc19-4277-ab3c-44128ddf41fe tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:07.794418 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-45ec8224-cc19-4277-ab3c-44128ddf41fe tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:07.810811 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-45ec8224-cc19-4277-ab3c-44128ddf41fe tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Getting quotas for project 9ab3a2e6c9634a06b33f1d82a28dc3f1. Resources: {'instances', 'cores', 'ram'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:45:07.814780 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-45ec8224-cc19-4277-ab3c-44128ddf41fe tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Getting quotas for user 1a93ea9f0a3f47d68e53c464c1d52c92 and project 9ab3a2e6c9634a06b33f1d82a28dc3f1. Resources: {'instances', 'cores', 'ram'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:45:07.826295 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-45ec8224-cc19-4277-ab3c-44128ddf41fe tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Going to run 1 instances... {{(pid=124357) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:45:07.828581 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-45ec8224-cc19-4277-ab3c-44128ddf41fe tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ac7d441e-2ac8-49ad-9dc5-3c55bd4b4f8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:45:07.875035 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-45ec8224-cc19-4277-ab3c-44128ddf41fe tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.672488 Jun 23 22:45:07.875603 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 451/881] 10.222.0.43 () {62 vars in 1187 bytes} [Thu Jun 23 22:45:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 23 22:45:07.887039 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-4da416f6-f55c-473f-9b61-d30fdf594cb3 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:07.887657 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-4da416f6-f55c-473f-9b61-d30fdf594cb3 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:07.947429 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4da416f6-f55c-473f-9b61-d30fdf594cb3 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:07.955228 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4da416f6-f55c-473f-9b61-d30fdf594cb3 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:07.957357 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4da416f6-f55c-473f-9b61-d30fdf594cb3 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:07.958519 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-4da416f6-f55c-473f-9b61-d30fdf594cb3 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1281 microversion: 2.20 time: 0.075946 Jun 23 22:45:07.959313 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 431/882] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:45:07 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1281 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:45:08.012643 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-9dbbe383-7405-4990-ae23-d020bcfa85f2 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8937ec59-7c25-49b3-bda8-6b9f7448242a", "device": "/dev/sdb"}} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:45:08.014341 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-9dbbe383-7405-4990-ae23-d020bcfa85f2 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] [instance: 9717199a-93d2-479c-a903-818a5e93b841] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:08.020533 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9dbbe383-7405-4990-ae23-d020bcfa85f2 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:08.021042 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9dbbe383-7405-4990-ae23-d020bcfa85f2 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:08.021798 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9dbbe383-7405-4990-ae23-d020bcfa85f2 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:08.022225 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9dbbe383-7405-4990-ae23-d020bcfa85f2 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:08.278608 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-9dbbe383-7405-4990-ae23-d020bcfa85f2 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] 10.222.0.43 "POST /compute/v2.1/servers/9717199a-93d2-479c-a903-818a5e93b841/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269751 Jun 23 22:45:08.279364 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 452/883] 10.222.0.43 () {60 vars in 1322 bytes} [Thu Jun 23 22:45:08 2022] POST /compute/v2.1/servers/9717199a-93d2-479c-a903-818a5e93b841/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:45:08.976658 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-0f7c5107-5a78-4c58-a796-71c664781774 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:08.977299 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-0f7c5107-5a78-4c58-a796-71c664781774 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:08.984168 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0f7c5107-5a78-4c58-a796-71c664781774 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:08.984610 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0f7c5107-5a78-4c58-a796-71c664781774 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:08.985375 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0f7c5107-5a78-4c58-a796-71c664781774 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:08.985803 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0f7c5107-5a78-4c58-a796-71c664781774 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:09.064765 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-0f7c5107-5a78-4c58-a796-71c664781774 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:09.073671 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-0f7c5107-5a78-4c58-a796-71c664781774 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:09.075296 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-0f7c5107-5a78-4c58-a796-71c664781774 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:09.076395 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-0f7c5107-5a78-4c58-a796-71c664781774 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1351 microversion: 2.20 time: 0.103854 Jun 23 22:45:09.076943 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 432/884] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:45:08 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1351 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:45:10.094907 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-efcf1883-0878-4901-8dab-3e8f0b7a9e8e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:10.095762 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-efcf1883-0878-4901-8dab-3e8f0b7a9e8e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:10.102490 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-efcf1883-0878-4901-8dab-3e8f0b7a9e8e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:10.103040 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-efcf1883-0878-4901-8dab-3e8f0b7a9e8e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:10.103897 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-efcf1883-0878-4901-8dab-3e8f0b7a9e8e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:10.104390 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-efcf1883-0878-4901-8dab-3e8f0b7a9e8e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:10.299432 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-efcf1883-0878-4901-8dab-3e8f0b7a9e8e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:10.307331 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-efcf1883-0878-4901-8dab-3e8f0b7a9e8e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:10.308829 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-efcf1883-0878-4901-8dab-3e8f0b7a9e8e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:10.309930 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-efcf1883-0878-4901-8dab-3e8f0b7a9e8e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1407 microversion: 2.20 time: 0.220020 Jun 23 22:45:10.310482 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 453/885] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:45:10 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:45:10.428127 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-33df3ec0-b6f1-4c44-92cc-315900698b07 req-daf7761d-2723-4a18-96de-b7730c25787b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe4cae6a-0365-477a-bbcb-100245e62715", "tag": "ca42cad6-fa77-4fa7-b9e0-48ce41a63154"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:45:10.453205 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-33df3ec0-b6f1-4c44-92cc-315900698b07 req-daf7761d-2723-4a18-96de-b7730c25787b service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:10.453656 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-33df3ec0-b6f1-4c44-92cc-315900698b07 req-daf7761d-2723-4a18-96de-b7730c25787b service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:10.466971 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-33df3ec0-b6f1-4c44-92cc-315900698b07 req-daf7761d-2723-4a18-96de-b7730c25787b service nova] Creating event network-changed:ca42cad6-fa77-4fa7-b9e0-48ce41a63154 for instance fe4cae6a-0365-477a-bbcb-100245e62715 on hv-cinder-84617 Jun 23 22:45:10.472257 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-33df3ec0-b6f1-4c44-92cc-315900698b07 req-daf7761d-2723-4a18-96de-b7730c25787b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050269 Jun 23 22:45:10.473336 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 433/886] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:45:11.329086 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-91d2f9bb-1cc7-4978-9029-442b1280a6bb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:11.329700 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-91d2f9bb-1cc7-4978-9029-442b1280a6bb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:11.337331 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-91d2f9bb-1cc7-4978-9029-442b1280a6bb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:11.337776 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-91d2f9bb-1cc7-4978-9029-442b1280a6bb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:11.338526 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-91d2f9bb-1cc7-4978-9029-442b1280a6bb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:11.338979 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-91d2f9bb-1cc7-4978-9029-442b1280a6bb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:11.467576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-91d2f9bb-1cc7-4978-9029-442b1280a6bb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:11.476409 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-91d2f9bb-1cc7-4978-9029-442b1280a6bb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:11.477916 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-91d2f9bb-1cc7-4978-9029-442b1280a6bb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:11.479058 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-91d2f9bb-1cc7-4978-9029-442b1280a6bb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1407 microversion: 2.20 time: 0.154039 Jun 23 22:45:11.479609 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 454/887] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:45:11 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:45:12.497615 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-5e5e8d54-65ae-4b23-932d-137726b57780 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:12.498310 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-5e5e8d54-65ae-4b23-932d-137726b57780 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:12.505592 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5e5e8d54-65ae-4b23-932d-137726b57780 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:12.505930 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5e5e8d54-65ae-4b23-932d-137726b57780 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:12.506665 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5e5e8d54-65ae-4b23-932d-137726b57780 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:12.507133 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5e5e8d54-65ae-4b23-932d-137726b57780 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:12.645835 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-5e5e8d54-65ae-4b23-932d-137726b57780 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:12.653768 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-5e5e8d54-65ae-4b23-932d-137726b57780 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:12.655264 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-5e5e8d54-65ae-4b23-932d-137726b57780 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:12.656362 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-5e5e8d54-65ae-4b23-932d-137726b57780 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1407 microversion: 2.20 time: 0.162975 Jun 23 22:45:12.656915 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 434/888] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:45:12 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:45:13.675006 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-a43c18b7-b6e1-4662-9b59-87d3acbf84a8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:13.675643 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-a43c18b7-b6e1-4662-9b59-87d3acbf84a8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:13.682622 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a43c18b7-b6e1-4662-9b59-87d3acbf84a8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:13.683094 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a43c18b7-b6e1-4662-9b59-87d3acbf84a8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:13.683860 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a43c18b7-b6e1-4662-9b59-87d3acbf84a8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:13.684287 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a43c18b7-b6e1-4662-9b59-87d3acbf84a8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:13.815954 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-a43c18b7-b6e1-4662-9b59-87d3acbf84a8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:13.825144 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-a43c18b7-b6e1-4662-9b59-87d3acbf84a8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:13.826627 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-a43c18b7-b6e1-4662-9b59-87d3acbf84a8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:13.827803 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-a43c18b7-b6e1-4662-9b59-87d3acbf84a8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1407 microversion: 2.20 time: 0.156716 Jun 23 22:45:13.828299 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 455/889] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:45:13 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:45:14.845449 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-020b1f79-aafe-4b21-afd4-75330c06a4ec tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:14.846081 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-020b1f79-aafe-4b21-afd4-75330c06a4ec tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:14.858797 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [req-790393ca-5c60-4db1-bbbf-8564d4e9b7d0 req-99ffcdee-34ee-48d3-9fb9-86717516100c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe4cae6a-0365-477a-bbcb-100245e62715", "name": "network-vif-plugged", "status": "completed", "tag": "ca42cad6-fa77-4fa7-b9e0-48ce41a63154"}]} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:45:14.865944 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-020b1f79-aafe-4b21-afd4-75330c06a4ec tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:14.866395 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-020b1f79-aafe-4b21-afd4-75330c06a4ec tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:14.867210 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-020b1f79-aafe-4b21-afd4-75330c06a4ec tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:14.867640 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-020b1f79-aafe-4b21-afd4-75330c06a4ec tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:14.876940 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-790393ca-5c60-4db1-bbbf-8564d4e9b7d0 req-99ffcdee-34ee-48d3-9fb9-86717516100c service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:14.877330 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-790393ca-5c60-4db1-bbbf-8564d4e9b7d0 req-99ffcdee-34ee-48d3-9fb9-86717516100c service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:14.899551 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.compute.server_external_events [req-790393ca-5c60-4db1-bbbf-8564d4e9b7d0 req-99ffcdee-34ee-48d3-9fb9-86717516100c service nova] Creating event network-vif-plugged:ca42cad6-fa77-4fa7-b9e0-48ce41a63154 for instance fe4cae6a-0365-477a-bbcb-100245e62715 on hv-cinder-84617 Jun 23 22:45:14.907118 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [req-790393ca-5c60-4db1-bbbf-8564d4e9b7d0 req-99ffcdee-34ee-48d3-9fb9-86717516100c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052281 Jun 23 22:45:14.919398 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 456/890] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:45:15.028447 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-020b1f79-aafe-4b21-afd4-75330c06a4ec tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:15.037391 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-020b1f79-aafe-4b21-afd4-75330c06a4ec tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:15.038962 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-020b1f79-aafe-4b21-afd4-75330c06a4ec tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:15.040141 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-020b1f79-aafe-4b21-afd4-75330c06a4ec tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1407 microversion: 2.20 time: 0.198534 Jun 23 22:45:15.040661 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 435/891] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:45:14 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:45:16.059251 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-4b947ecd-7b99-43a4-99c2-eba1d0b1723b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:16.060042 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-4b947ecd-7b99-43a4-99c2-eba1d0b1723b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:16.066714 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-4b947ecd-7b99-43a4-99c2-eba1d0b1723b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:16.067398 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-4b947ecd-7b99-43a4-99c2-eba1d0b1723b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:16.068052 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-4b947ecd-7b99-43a4-99c2-eba1d0b1723b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:16.068488 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-4b947ecd-7b99-43a4-99c2-eba1d0b1723b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:16.195986 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-4b947ecd-7b99-43a4-99c2-eba1d0b1723b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:16.203836 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-4b947ecd-7b99-43a4-99c2-eba1d0b1723b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:16.205361 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-4b947ecd-7b99-43a4-99c2-eba1d0b1723b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:16.206465 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-4b947ecd-7b99-43a4-99c2-eba1d0b1723b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1407 microversion: 2.20 time: 0.151595 Jun 23 22:45:16.207040 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 457/892] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:45:16 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:45:17.225195 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-ed1808f9-36d7-41f5-a7db-9d64286f1641 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:17.225797 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-ed1808f9-36d7-41f5-a7db-9d64286f1641 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:17.232307 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ed1808f9-36d7-41f5-a7db-9d64286f1641 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:17.232746 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ed1808f9-36d7-41f5-a7db-9d64286f1641 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:17.233500 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ed1808f9-36d7-41f5-a7db-9d64286f1641 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:17.233928 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ed1808f9-36d7-41f5-a7db-9d64286f1641 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:17.365105 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ed1808f9-36d7-41f5-a7db-9d64286f1641 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:17.372930 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ed1808f9-36d7-41f5-a7db-9d64286f1641 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:17.374454 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ed1808f9-36d7-41f5-a7db-9d64286f1641 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:17.375615 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-ed1808f9-36d7-41f5-a7db-9d64286f1641 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1407 microversion: 2.20 time: 0.155146 Jun 23 22:45:17.376167 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 436/893] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:45:17 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:45:18.393676 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-f8e6902e-dfd6-4707-bf0e-8ad14c55d53a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:18.394305 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-f8e6902e-dfd6-4707-bf0e-8ad14c55d53a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:18.397290 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell0:SELECT=2 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:45:18.397934 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell0:SELECT=6 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:45:18.403924 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f8e6902e-dfd6-4707-bf0e-8ad14c55d53a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:18.404361 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f8e6902e-dfd6-4707-bf0e-8ad14c55d53a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:18.405110 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f8e6902e-dfd6-4707-bf0e-8ad14c55d53a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:18.405535 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f8e6902e-dfd6-4707-bf0e-8ad14c55d53a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:18.536486 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-f8e6902e-dfd6-4707-bf0e-8ad14c55d53a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:18.545411 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-f8e6902e-dfd6-4707-bf0e-8ad14c55d53a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:18.546902 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-f8e6902e-dfd6-4707-bf0e-8ad14c55d53a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:18.548072 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-f8e6902e-dfd6-4707-bf0e-8ad14c55d53a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1407 microversion: 2.20 time: 0.158281 Jun 23 22:45:18.548711 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 458/894] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:45:18 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:45:19.566446 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-2d33d320-a7c8-4fcc-af0e-98e754b05530 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:19.567113 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-2d33d320-a7c8-4fcc-af0e-98e754b05530 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:19.569042 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=6 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:45:19.575802 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2d33d320-a7c8-4fcc-af0e-98e754b05530 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:19.576239 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2d33d320-a7c8-4fcc-af0e-98e754b05530 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:19.576994 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2d33d320-a7c8-4fcc-af0e-98e754b05530 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:19.577421 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2d33d320-a7c8-4fcc-af0e-98e754b05530 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:19.708601 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-2d33d320-a7c8-4fcc-af0e-98e754b05530 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:19.716566 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-2d33d320-a7c8-4fcc-af0e-98e754b05530 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:19.718003 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-2d33d320-a7c8-4fcc-af0e-98e754b05530 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:19.719142 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-2d33d320-a7c8-4fcc-af0e-98e754b05530 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1407 microversion: 2.20 time: 0.156602 Jun 23 22:45:19.719718 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 437/895] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:45:19 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:45:20.737634 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-240bde9c-d199-4755-8b8a-896ef5ffc61e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:20.738248 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-240bde9c-d199-4755-8b8a-896ef5ffc61e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:20.745279 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-240bde9c-d199-4755-8b8a-896ef5ffc61e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:20.745725 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-240bde9c-d199-4755-8b8a-896ef5ffc61e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:20.746487 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-240bde9c-d199-4755-8b8a-896ef5ffc61e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:20.746938 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-240bde9c-d199-4755-8b8a-896ef5ffc61e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:20.878729 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-240bde9c-d199-4755-8b8a-896ef5ffc61e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:20.886730 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-240bde9c-d199-4755-8b8a-896ef5ffc61e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:20.888564 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-240bde9c-d199-4755-8b8a-896ef5ffc61e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:20.889722 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-240bde9c-d199-4755-8b8a-896ef5ffc61e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1598 microversion: 2.20 time: 0.156060 Jun 23 22:45:20.890284 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 459/896] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:45:20 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:45:20.907914 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d263d8e4-f3a2-4bb4-9c80-d2c07e6ccd3b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:20.908414 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-d263d8e4-f3a2-4bb4-9c80-d2c07e6ccd3b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:20.915812 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d263d8e4-f3a2-4bb4-9c80-d2c07e6ccd3b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:20.916251 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d263d8e4-f3a2-4bb4-9c80-d2c07e6ccd3b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:20.917425 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d263d8e4-f3a2-4bb4-9c80-d2c07e6ccd3b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:20.918161 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d263d8e4-f3a2-4bb4-9c80-d2c07e6ccd3b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:20.998476 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d263d8e4-f3a2-4bb4-9c80-d2c07e6ccd3b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094510 Jun 23 22:45:20.999097 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 438/897] 10.222.0.43 () {60 vars in 1315 bytes} [Thu Jun 23 22:45:20 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 22:45:22.158527 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [req-a483c39a-7c0a-4470-bb3d-8be6728a38a1 req-7f078b09-11a1-4528-a98a-9fab1abd21ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe4cae6a-0365-477a-bbcb-100245e62715", "tag": "ca42cad6-fa77-4fa7-b9e0-48ce41a63154"}]} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:45:22.168019 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-a483c39a-7c0a-4470-bb3d-8be6728a38a1 req-7f078b09-11a1-4528-a98a-9fab1abd21ff service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:22.168471 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-a483c39a-7c0a-4470-bb3d-8be6728a38a1 req-7f078b09-11a1-4528-a98a-9fab1abd21ff service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:22.180001 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.compute.server_external_events [req-a483c39a-7c0a-4470-bb3d-8be6728a38a1 req-7f078b09-11a1-4528-a98a-9fab1abd21ff service nova] Creating event network-changed:ca42cad6-fa77-4fa7-b9e0-48ce41a63154 for instance fe4cae6a-0365-477a-bbcb-100245e62715 on hv-cinder-84617 Jun 23 22:45:22.184792 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [req-a483c39a-7c0a-4470-bb3d-8be6728a38a1 req-7f078b09-11a1-4528-a98a-9fab1abd21ff service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029979 Jun 23 22:45:22.185380 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 460/898] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:45:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:45:30.948251 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:45:30.949019 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:45:30.953000 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-3d90ba4e-f4d3-4aa0-bef4-5dd4e97f5c8a tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:30.953441 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-3d90ba4e-f4d3-4aa0-bef4-5dd4e97f5c8a tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] [instance: 9717199a-93d2-479c-a903-818a5e93b841] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:30.961686 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3d90ba4e-f4d3-4aa0-bef4-5dd4e97f5c8a tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:30.962077 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3d90ba4e-f4d3-4aa0-bef4-5dd4e97f5c8a tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:30.962833 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3d90ba4e-f4d3-4aa0-bef4-5dd4e97f5c8a tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:30.963286 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3d90ba4e-f4d3-4aa0-bef4-5dd4e97f5c8a tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:31.049758 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.objects.instance [None req-3d90ba4e-f4d3-4aa0-bef4-5dd4e97f5c8a tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lazy-loading 'services' on Instance uuid 9717199a-93d2-479c-a903-818a5e93b841 {{(pid=124358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:45:31.119887 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-3d90ba4e-f4d3-4aa0-bef4-5dd4e97f5c8a tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9717199a-93d2-479c-a903-818a5e93b841/os-volume_attachments/8937ec59-7c25-49b3-bda8-6b9f7448242a" status: 202 len: 0 microversion: 2.1 time: 0.172694 Jun 23 22:45:31.120534 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 439/899] 10.222.0.43 () {58 vars in 1415 bytes} [Thu Jun 23 22:45:30 2022] DELETE /compute/v2.1/servers/9717199a-93d2-479c-a903-818a5e93b841/os-volume_attachments/8937ec59-7c25-49b3-bda8-6b9f7448242a => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:45:32.235535 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:45:32.236278 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:45:32.240855 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-9b6c9077-29e9-459f-9b04-7e352683fbf9 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:32.241438 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-9b6c9077-29e9-459f-9b04-7e352683fbf9 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] [instance: 9717199a-93d2-479c-a903-818a5e93b841] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:32.252293 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9b6c9077-29e9-459f-9b04-7e352683fbf9 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:32.252737 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9b6c9077-29e9-459f-9b04-7e352683fbf9 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:32.253499 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9b6c9077-29e9-459f-9b04-7e352683fbf9 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:32.253965 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9b6c9077-29e9-459f-9b04-7e352683fbf9 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:32.280275 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-9b6c9077-29e9-459f-9b04-7e352683fbf9 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] [instance: 9717199a-93d2-479c-a903-818a5e93b841] Going to try to terminate instance {{(pid=124357) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:45:32.354288 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-9b6c9077-29e9-459f-9b04-7e352683fbf9 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] 10.222.0.43 "DELETE /compute/v2.1/servers/9717199a-93d2-479c-a903-818a5e93b841" status: 204 len: 0 microversion: 2.1 time: 0.120091 Jun 23 22:45:32.355183 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 461/900] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 23 22:45:32 2022] DELETE /compute/v2.1/servers/9717199a-93d2-479c-a903-818a5e93b841 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 22:45:32.365714 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-bb9d8088-6074-4c91-83eb-88e92c29278a tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:32.366411 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-bb9d8088-6074-4c91-83eb-88e92c29278a tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] [instance: 9717199a-93d2-479c-a903-818a5e93b841] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:32.372725 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bb9d8088-6074-4c91-83eb-88e92c29278a tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:32.373173 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bb9d8088-6074-4c91-83eb-88e92c29278a tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:32.373927 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bb9d8088-6074-4c91-83eb-88e92c29278a tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:32.374357 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-bb9d8088-6074-4c91-83eb-88e92c29278a tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:32.505888 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-bb9d8088-6074-4c91-83eb-88e92c29278a tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87b9f9f1adc4c2bb9da82df9d27802e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a0d4c968d84b02977004edf46cde48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:32.513373 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-bb9d8088-6074-4c91-83eb-88e92c29278a tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] 10.222.0.43 "GET /compute/v2.1/servers/9717199a-93d2-479c-a903-818a5e93b841" status: 200 len: 1514 microversion: 2.1 time: 0.152860 Jun 23 22:45:32.514116 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 440/901] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:32 2022] GET /compute/v2.1/servers/9717199a-93d2-479c-a903-818a5e93b841 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:33.531675 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-d6bb3ae7-0d5d-41f8-8ed7-b3087cc52d86 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:33.532372 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-d6bb3ae7-0d5d-41f8-8ed7-b3087cc52d86 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] [instance: 9717199a-93d2-479c-a903-818a5e93b841] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:33.539233 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d6bb3ae7-0d5d-41f8-8ed7-b3087cc52d86 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:33.539672 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d6bb3ae7-0d5d-41f8-8ed7-b3087cc52d86 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:33.540424 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d6bb3ae7-0d5d-41f8-8ed7-b3087cc52d86 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:33.540840 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d6bb3ae7-0d5d-41f8-8ed7-b3087cc52d86 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:33.675181 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-d6bb3ae7-0d5d-41f8-8ed7-b3087cc52d86 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87b9f9f1adc4c2bb9da82df9d27802e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a0d4c968d84b02977004edf46cde48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:33.683054 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-d6bb3ae7-0d5d-41f8-8ed7-b3087cc52d86 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] 10.222.0.43 "GET /compute/v2.1/servers/9717199a-93d2-479c-a903-818a5e93b841" status: 200 len: 1514 microversion: 2.1 time: 0.155538 Jun 23 22:45:33.683630 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 462/902] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:33 2022] GET /compute/v2.1/servers/9717199a-93d2-479c-a903-818a5e93b841 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:34.585505 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-e095c71f-5a53-404d-ae33-c679869dea0e req-c28de3c3-8f12-4d14-a245-ae3e72c019d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9717199a-93d2-479c-a903-818a5e93b841", "name": "network-vif-deleted", "tag": "e63211d3-926c-49a4-9403-d08483acf737"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:45:34.598038 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-e095c71f-5a53-404d-ae33-c679869dea0e req-c28de3c3-8f12-4d14-a245-ae3e72c019d2 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:34.598492 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-e095c71f-5a53-404d-ae33-c679869dea0e req-c28de3c3-8f12-4d14-a245-ae3e72c019d2 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:34.614735 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-e095c71f-5a53-404d-ae33-c679869dea0e req-c28de3c3-8f12-4d14-a245-ae3e72c019d2 service nova] Creating event network-vif-deleted:e63211d3-926c-49a4-9403-d08483acf737 for instance 9717199a-93d2-479c-a903-818a5e93b841 on hv-cinder-84617 Jun 23 22:45:34.621826 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-e095c71f-5a53-404d-ae33-c679869dea0e req-c28de3c3-8f12-4d14-a245-ae3e72c019d2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040474 Jun 23 22:45:34.622408 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 441/903] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:45:34.699628 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-ea545617-ac9c-4398-b593-45946b965da4 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:34.701403 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-ea545617-ac9c-4398-b593-45946b965da4 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] [instance: 9717199a-93d2-479c-a903-818a5e93b841] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:34.709868 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ea545617-ac9c-4398-b593-45946b965da4 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:34.710309 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ea545617-ac9c-4398-b593-45946b965da4 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:34.711104 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ea545617-ac9c-4398-b593-45946b965da4 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:34.711528 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ea545617-ac9c-4398-b593-45946b965da4 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:34.743093 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ea545617-ac9c-4398-b593-45946b965da4 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:34.743529 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ea545617-ac9c-4398-b593-45946b965da4 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:34.743970 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.objects.instance [None req-ea545617-ac9c-4398-b593-45946b965da4 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lazy-loading 'fault' on Instance uuid 9717199a-93d2-479c-a903-818a5e93b841 {{(pid=124357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:45:34.783424 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-ea545617-ac9c-4398-b593-45946b965da4 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87b9f9f1adc4c2bb9da82df9d27802e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a0d4c968d84b02977004edf46cde48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:34.791467 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-ea545617-ac9c-4398-b593-45946b965da4 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] 10.222.0.43 "GET /compute/v2.1/servers/9717199a-93d2-479c-a903-818a5e93b841" status: 200 len: 1309 microversion: 2.1 time: 0.095724 Jun 23 22:45:34.792025 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 463/904] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:34 2022] GET /compute/v2.1/servers/9717199a-93d2-479c-a903-818a5e93b841 => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:35.809993 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-8272c158-a5e5-4a6a-8349-1bd170962f3e tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:35.810711 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-8272c158-a5e5-4a6a-8349-1bd170962f3e tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] [instance: 9717199a-93d2-479c-a903-818a5e93b841] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:35.817314 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8272c158-a5e5-4a6a-8349-1bd170962f3e tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:35.817747 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8272c158-a5e5-4a6a-8349-1bd170962f3e tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:35.818633 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8272c158-a5e5-4a6a-8349-1bd170962f3e tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:35.819094 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8272c158-a5e5-4a6a-8349-1bd170962f3e tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:35.831814 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-8272c158-a5e5-4a6a-8349-1bd170962f3e tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] HTTP exception thrown: Instance 9717199a-93d2-479c-a903-818a5e93b841 could not be found. Jun 23 22:45:35.833398 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-8272c158-a5e5-4a6a-8349-1bd170962f3e tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Request method failure captured: Jun 23 22:45:35.833398 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: request: GET /compute/v2.1/servers/9717199a-93d2-479c-a903-818a5e93b841 HTTP/1.1 Jun 23 22:45:35.833398 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept: application/json Jun 23 22:45:35.833398 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Jun 23 22:45:35.833398 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Connection: close Jun 23 22:45:35.833398 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Length: 0 Jun 23 22:45:35.833398 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Type: application/json Jun 23 22:45:35.833398 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Host: 10.222.0.43 Jun 23 22:45:35.833398 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Jun 23 22:45:35.833398 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.9 Jun 23 22:45:35.833398 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABitOzRi2ndElzubFVUu4IRhFkM2HT4hxiXS_UEWDlTrGyPaYaOb21npGnFOLxXNMZTMZKHyAVOlK1FqcOkSu_7W-l-1di4h1qoJD68B5Qw16IM1bJZa7So3s4-gJhGQExN_MTfZ1N5ZFdKxxwepBlpbKVyZi8of2RINRo3y28tWtR4dvo Jun 23 22:45:35.833398 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Jun 23 22:45:35.833398 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Jun 23 22:45:35.833398 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Jun 23 22:45:35.833398 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Jun 23 22:45:35.833398 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Jun 23 22:45:35.833398 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Jun 23 22:45:35.833398 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Id: 65a0d4c968d84b02977004edf46cde48 Jun 23 22:45:35.833398 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1117270034 Jun 23 22:45:35.833398 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Role: reader,member Jun 23 22:45:35.833398 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Roles: reader,member Jun 23 22:45:35.835701 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/65a0d4c968d84b02977004edf46cde48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/65a0d4c968d84b02977004edf46cde48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_65a0d4c968d84b02977004edf46cde48", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/65a0d4c968d84b02977004edf46cde48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:45:35.835701 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-VolumesSnapshotTestJSON-1117270034 Jun 23 22:45:35.835701 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Id: 65a0d4c968d84b02977004edf46cde48 Jun 23 22:45:35.835701 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1117270034 Jun 23 22:45:35.835701 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User: tempest-VolumesSnapshotTestJSON-1117270034-project Jun 23 22:45:35.835701 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Jun 23 22:45:35.835701 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Jun 23 22:45:35.835701 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Id: f87b9f9f1adc4c2bb9da82df9d27802e Jun 23 22:45:35.835701 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-VolumesSnapshotTestJSON-1117270034-project Jun 23 22:45:35.835701 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: method: > Jun 23 22:45:35.835701 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: exception: Instance 9717199a-93d2-479c-a903-818a5e93b841 could not be found. Jun 23 22:45:35.835701 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: action_args: {'id': '9717199a-93d2-479c-a903-818a5e93b841'} Jun 23 22:45:35.836901 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:45:35.836901 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:45:35.836901 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:45:35.836901 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:45:35.836901 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:45:35.836901 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:45:35.836901 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:45:35.836901 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:45:35.836901 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:45:35.836901 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:45:35.836901 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9717199a-93d2-479c-a903-818a5e93b841 could not be found. Jun 23 22:45:35.836901 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:45:35.836901 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:45:35.836901 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:45:35.836901 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:45:35.836901 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:45:35.836901 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:45:35.836901 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:45:35.836901 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:45:35.836901 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:45:35.838522 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:45:35.838522 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:45:35.838522 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:45:35.838522 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:45:35.838522 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:45:35.838522 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:45:35.838522 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:45:35.838522 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9717199a-93d2-479c-a903-818a5e93b841 could not be found. Jun 23 22:45:35.838522 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:45:35.838522 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:45:35.838522 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:45:35.838522 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:45:35.838522 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:45:35.838522 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:45:35.838522 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:45:35.838522 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:45:35.838522 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9717199a-93d2-479c-a903-818a5e93b841 could not be found. Jun 23 22:45:35.838522 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:45:35.840030 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-8272c158-a5e5-4a6a-8349-1bd170962f3e tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Returning 404 to user: Instance 9717199a-93d2-479c-a903-818a5e93b841 could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:45:35.840030 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-8272c158-a5e5-4a6a-8349-1bd170962f3e tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] 10.222.0.43 "GET /compute/v2.1/servers/9717199a-93d2-479c-a903-818a5e93b841" status: 404 len: 111 microversion: 2.1 time: 0.029596 Jun 23 22:45:35.840030 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 442/905] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:35 2022] GET /compute/v2.1/servers/9717199a-93d2-479c-a903-818a5e93b841 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:45:45.726258 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-2628fb2a-b496-4943-9797-e96b94d9dc39 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1288118671", "imageRef": "ac7d441e-2ac8-49ad-9dc5-3c55bd4b4f8b", "flavorRef": "452", "networks": [{"uuid": "c5b80e41-df9f-4702-ac94-81d6f7484421"}]}} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:45:45.733617 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:45:45.734274 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:45:45.781034 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.network.neutron [None req-2628fb2a-b496-4943-9797-e96b94d9dc39 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] validate_networks() for [('c5b80e41-df9f-4702-ac94-81d6f7484421', None, None, None, None, None)] {{(pid=124357) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:45:46.121464 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-2628fb2a-b496-4943-9797-e96b94d9dc39 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Flavor limits 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:45:46.121899 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-2628fb2a-b496-4943-9797-e96b94d9dc39 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Image limits 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:45:46.122402 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-2628fb2a-b496-4943-9797-e96b94d9dc39 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Flavor pref 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:45:46.122815 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-2628fb2a-b496-4943-9797-e96b94d9dc39 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Image pref 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:45:46.123254 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-2628fb2a-b496-4943-9797-e96b94d9dc39 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:45:46.133600 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2628fb2a-b496-4943-9797-e96b94d9dc39 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:46.134055 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2628fb2a-b496-4943-9797-e96b94d9dc39 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:46.134859 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2628fb2a-b496-4943-9797-e96b94d9dc39 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:46.135320 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2628fb2a-b496-4943-9797-e96b94d9dc39 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:46.152882 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-2628fb2a-b496-4943-9797-e96b94d9dc39 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Getting quotas for project 65a0d4c968d84b02977004edf46cde48. Resources: {'instances', 'cores', 'ram'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:45:46.157782 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-2628fb2a-b496-4943-9797-e96b94d9dc39 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Getting quotas for user f87b9f9f1adc4c2bb9da82df9d27802e and project 65a0d4c968d84b02977004edf46cde48. Resources: {'instances', 'cores', 'ram'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:45:46.168858 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-2628fb2a-b496-4943-9797-e96b94d9dc39 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Going to run 1 instances... {{(pid=124357) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:45:46.171468 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-2628fb2a-b496-4943-9797-e96b94d9dc39 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] [instance: b468c753-6209-4dd0-bc03-2ca596237f8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ac7d441e-2ac8-49ad-9dc5-3c55bd4b4f8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:45:46.218097 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-2628fb2a-b496-4943-9797-e96b94d9dc39 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.496099 Jun 23 22:45:46.218750 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 464/906] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Jun 23 22:45:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 22:45:46.228488 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-dcd38bef-6921-48f4-a511-d31e63c52770 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:46.229099 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-dcd38bef-6921-48f4-a511-d31e63c52770 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] [instance: b468c753-6209-4dd0-bc03-2ca596237f8a] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:46.231718 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=8 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:45:46.232394 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:45:46.304903 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-dcd38bef-6921-48f4-a511-d31e63c52770 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87b9f9f1adc4c2bb9da82df9d27802e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a0d4c968d84b02977004edf46cde48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:46.313449 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-dcd38bef-6921-48f4-a511-d31e63c52770 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] 10.222.0.43 "GET /compute/v2.1/servers/b468c753-6209-4dd0-bc03-2ca596237f8a" status: 200 len: 1219 microversion: 2.1 time: 0.088723 Jun 23 22:45:46.314023 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 443/907] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:46 2022] GET /compute/v2.1/servers/b468c753-6209-4dd0-bc03-2ca596237f8a => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:47.330201 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-9978d8dc-8227-4379-bac3-04a6a70d81e8 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:47.330946 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-9978d8dc-8227-4379-bac3-04a6a70d81e8 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] [instance: b468c753-6209-4dd0-bc03-2ca596237f8a] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:47.338290 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9978d8dc-8227-4379-bac3-04a6a70d81e8 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:47.338743 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9978d8dc-8227-4379-bac3-04a6a70d81e8 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:47.339544 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9978d8dc-8227-4379-bac3-04a6a70d81e8 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:47.339979 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9978d8dc-8227-4379-bac3-04a6a70d81e8 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:47.430468 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-9978d8dc-8227-4379-bac3-04a6a70d81e8 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87b9f9f1adc4c2bb9da82df9d27802e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a0d4c968d84b02977004edf46cde48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:47.438218 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-9978d8dc-8227-4379-bac3-04a6a70d81e8 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] 10.222.0.43 "GET /compute/v2.1/servers/b468c753-6209-4dd0-bc03-2ca596237f8a" status: 200 len: 1289 microversion: 2.1 time: 0.111817 Jun 23 22:45:47.439084 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 465/908] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:47 2022] GET /compute/v2.1/servers/b468c753-6209-4dd0-bc03-2ca596237f8a => generated 1289 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:48.456073 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-58442d96-17ab-48c4-8b41-b6588887f174 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:48.456686 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-58442d96-17ab-48c4-8b41-b6588887f174 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] [instance: b468c753-6209-4dd0-bc03-2ca596237f8a] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:48.465154 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-58442d96-17ab-48c4-8b41-b6588887f174 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:48.465606 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-58442d96-17ab-48c4-8b41-b6588887f174 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:48.466382 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-58442d96-17ab-48c4-8b41-b6588887f174 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:48.466837 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-58442d96-17ab-48c4-8b41-b6588887f174 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:48.655444 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [req-1c33f239-e074-44a8-bbba-10e5c2f43b8a req-32df7064-0673-45e0-884d-e78c81d6de79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b468c753-6209-4dd0-bc03-2ca596237f8a", "tag": "a6e2f94a-c00b-44da-b961-092c392efbfb"}]} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:45:48.668350 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-1c33f239-e074-44a8-bbba-10e5c2f43b8a req-32df7064-0673-45e0-884d-e78c81d6de79 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:48.668827 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-1c33f239-e074-44a8-bbba-10e5c2f43b8a req-32df7064-0673-45e0-884d-e78c81d6de79 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:48.681060 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.compute.server_external_events [req-1c33f239-e074-44a8-bbba-10e5c2f43b8a req-32df7064-0673-45e0-884d-e78c81d6de79 service nova] Creating event network-changed:a6e2f94a-c00b-44da-b961-092c392efbfb for instance b468c753-6209-4dd0-bc03-2ca596237f8a on hv-cinder-84617 Jun 23 22:45:48.686361 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-58442d96-17ab-48c4-8b41-b6588887f174 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87b9f9f1adc4c2bb9da82df9d27802e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a0d4c968d84b02977004edf46cde48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:48.686889 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [req-1c33f239-e074-44a8-bbba-10e5c2f43b8a req-32df7064-0673-45e0-884d-e78c81d6de79 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035139 Jun 23 22:45:48.687569 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 466/909] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:45:48.699132 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-58442d96-17ab-48c4-8b41-b6588887f174 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] 10.222.0.43 "GET /compute/v2.1/servers/b468c753-6209-4dd0-bc03-2ca596237f8a" status: 200 len: 1319 microversion: 2.1 time: 0.246739 Jun 23 22:45:48.699707 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 444/910] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:48 2022] GET /compute/v2.1/servers/b468c753-6209-4dd0-bc03-2ca596237f8a => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:49.717125 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-3b5ccb94-c363-44d2-bb13-b704d196797e tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:49.717819 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-3b5ccb94-c363-44d2-bb13-b704d196797e tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] [instance: b468c753-6209-4dd0-bc03-2ca596237f8a] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:49.723994 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3b5ccb94-c363-44d2-bb13-b704d196797e tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:49.725007 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3b5ccb94-c363-44d2-bb13-b704d196797e tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:49.725764 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3b5ccb94-c363-44d2-bb13-b704d196797e tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:49.726189 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3b5ccb94-c363-44d2-bb13-b704d196797e tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:49.862880 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-3b5ccb94-c363-44d2-bb13-b704d196797e tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87b9f9f1adc4c2bb9da82df9d27802e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a0d4c968d84b02977004edf46cde48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:49.870450 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-3b5ccb94-c363-44d2-bb13-b704d196797e tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] 10.222.0.43 "GET /compute/v2.1/servers/b468c753-6209-4dd0-bc03-2ca596237f8a" status: 200 len: 1319 microversion: 2.1 time: 0.157975 Jun 23 22:45:49.871033 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 467/911] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:49 2022] GET /compute/v2.1/servers/b468c753-6209-4dd0-bc03-2ca596237f8a => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:50.887341 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-582294d6-4963-453f-a607-9369f3b1f565 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:50.887952 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-582294d6-4963-453f-a607-9369f3b1f565 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] [instance: b468c753-6209-4dd0-bc03-2ca596237f8a] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:50.894527 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-582294d6-4963-453f-a607-9369f3b1f565 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:50.903989 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-582294d6-4963-453f-a607-9369f3b1f565 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:50.903989 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-582294d6-4963-453f-a607-9369f3b1f565 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:50.903989 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-582294d6-4963-453f-a607-9369f3b1f565 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:51.285286 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-582294d6-4963-453f-a607-9369f3b1f565 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87b9f9f1adc4c2bb9da82df9d27802e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a0d4c968d84b02977004edf46cde48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:51.293958 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-582294d6-4963-453f-a607-9369f3b1f565 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] 10.222.0.43 "GET /compute/v2.1/servers/b468c753-6209-4dd0-bc03-2ca596237f8a" status: 200 len: 1319 microversion: 2.1 time: 0.410502 Jun 23 22:45:51.294766 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 445/912] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:50 2022] GET /compute/v2.1/servers/b468c753-6209-4dd0-bc03-2ca596237f8a => generated 1319 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:45:52.311841 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-6e10f38a-4da9-4f9d-b864-7fae907bb73d tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:52.312460 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-6e10f38a-4da9-4f9d-b864-7fae907bb73d tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] [instance: b468c753-6209-4dd0-bc03-2ca596237f8a] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:52.319211 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6e10f38a-4da9-4f9d-b864-7fae907bb73d tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:52.319652 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6e10f38a-4da9-4f9d-b864-7fae907bb73d tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:52.320411 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6e10f38a-4da9-4f9d-b864-7fae907bb73d tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:52.320842 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6e10f38a-4da9-4f9d-b864-7fae907bb73d tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:52.453574 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-6e10f38a-4da9-4f9d-b864-7fae907bb73d tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87b9f9f1adc4c2bb9da82df9d27802e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a0d4c968d84b02977004edf46cde48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:52.461501 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-6e10f38a-4da9-4f9d-b864-7fae907bb73d tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] 10.222.0.43 "GET /compute/v2.1/servers/b468c753-6209-4dd0-bc03-2ca596237f8a" status: 200 len: 1319 microversion: 2.1 time: 0.153667 Jun 23 22:45:52.462050 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 468/913] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:52 2022] GET /compute/v2.1/servers/b468c753-6209-4dd0-bc03-2ca596237f8a => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:53.478597 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-8fe97dcb-1774-4568-b57a-501b8b68a583 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:53.479266 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-8fe97dcb-1774-4568-b57a-501b8b68a583 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] [instance: b468c753-6209-4dd0-bc03-2ca596237f8a] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:53.485649 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8fe97dcb-1774-4568-b57a-501b8b68a583 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:53.486090 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8fe97dcb-1774-4568-b57a-501b8b68a583 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:53.486849 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8fe97dcb-1774-4568-b57a-501b8b68a583 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:53.487309 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8fe97dcb-1774-4568-b57a-501b8b68a583 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:53.619972 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-8fe97dcb-1774-4568-b57a-501b8b68a583 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87b9f9f1adc4c2bb9da82df9d27802e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a0d4c968d84b02977004edf46cde48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:53.627395 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-8fe97dcb-1774-4568-b57a-501b8b68a583 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] 10.222.0.43 "GET /compute/v2.1/servers/b468c753-6209-4dd0-bc03-2ca596237f8a" status: 200 len: 1319 microversion: 2.1 time: 0.153749 Jun 23 22:45:53.627956 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 446/914] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:53 2022] GET /compute/v2.1/servers/b468c753-6209-4dd0-bc03-2ca596237f8a => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:54.644214 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-d3ef691a-7e99-4afd-8637-d7c6709d5b88 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:54.644858 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-d3ef691a-7e99-4afd-8637-d7c6709d5b88 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] [instance: b468c753-6209-4dd0-bc03-2ca596237f8a] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:54.651603 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d3ef691a-7e99-4afd-8637-d7c6709d5b88 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:54.652050 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d3ef691a-7e99-4afd-8637-d7c6709d5b88 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:54.652811 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d3ef691a-7e99-4afd-8637-d7c6709d5b88 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:54.653246 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d3ef691a-7e99-4afd-8637-d7c6709d5b88 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:54.777582 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-d3ef691a-7e99-4afd-8637-d7c6709d5b88 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87b9f9f1adc4c2bb9da82df9d27802e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a0d4c968d84b02977004edf46cde48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:54.784985 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-d3ef691a-7e99-4afd-8637-d7c6709d5b88 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] 10.222.0.43 "GET /compute/v2.1/servers/b468c753-6209-4dd0-bc03-2ca596237f8a" status: 200 len: 1319 microversion: 2.1 time: 0.144658 Jun 23 22:45:54.785588 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 469/915] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:54 2022] GET /compute/v2.1/servers/b468c753-6209-4dd0-bc03-2ca596237f8a => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:55.066405 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-8110cc51-1e47-4ef5-a72d-03f08b24c4be req-cc5fc884-3448-4ed8-a1e7-94717200ceea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b468c753-6209-4dd0-bc03-2ca596237f8a", "name": "network-vif-plugged", "status": "completed", "tag": "a6e2f94a-c00b-44da-b961-092c392efbfb"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:45:55.076485 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-8110cc51-1e47-4ef5-a72d-03f08b24c4be req-cc5fc884-3448-4ed8-a1e7-94717200ceea service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:55.076943 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-8110cc51-1e47-4ef5-a72d-03f08b24c4be req-cc5fc884-3448-4ed8-a1e7-94717200ceea service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:55.088513 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-8110cc51-1e47-4ef5-a72d-03f08b24c4be req-cc5fc884-3448-4ed8-a1e7-94717200ceea service nova] Creating event network-vif-plugged:a6e2f94a-c00b-44da-b961-092c392efbfb for instance b468c753-6209-4dd0-bc03-2ca596237f8a on hv-cinder-84617 Jun 23 22:45:55.093843 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-8110cc51-1e47-4ef5-a72d-03f08b24c4be req-cc5fc884-3448-4ed8-a1e7-94717200ceea service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031086 Jun 23 22:45:55.094788 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 447/916] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:45:55.802598 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-a104ba67-b906-44d9-b88b-bc1c3cd0ffcf tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:55.803287 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-a104ba67-b906-44d9-b88b-bc1c3cd0ffcf tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] [instance: b468c753-6209-4dd0-bc03-2ca596237f8a] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:55.809686 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a104ba67-b906-44d9-b88b-bc1c3cd0ffcf tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:55.810120 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a104ba67-b906-44d9-b88b-bc1c3cd0ffcf tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:55.810871 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a104ba67-b906-44d9-b88b-bc1c3cd0ffcf tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:55.811322 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-a104ba67-b906-44d9-b88b-bc1c3cd0ffcf tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:55.937691 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-a104ba67-b906-44d9-b88b-bc1c3cd0ffcf tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87b9f9f1adc4c2bb9da82df9d27802e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a0d4c968d84b02977004edf46cde48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:55.945930 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-a104ba67-b906-44d9-b88b-bc1c3cd0ffcf tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] 10.222.0.43 "GET /compute/v2.1/servers/b468c753-6209-4dd0-bc03-2ca596237f8a" status: 200 len: 1319 microversion: 2.1 time: 0.147212 Jun 23 22:45:55.946488 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 470/917] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:55 2022] GET /compute/v2.1/servers/b468c753-6209-4dd0-bc03-2ca596237f8a => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:56.963424 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=2 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:45:56.967665 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-196d04a5-8194-4ccb-97b5-b2bace5eb423 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:56.968408 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-196d04a5-8194-4ccb-97b5-b2bace5eb423 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] [instance: b468c753-6209-4dd0-bc03-2ca596237f8a] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:56.975568 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-196d04a5-8194-4ccb-97b5-b2bace5eb423 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:56.976016 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-196d04a5-8194-4ccb-97b5-b2bace5eb423 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:56.976777 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-196d04a5-8194-4ccb-97b5-b2bace5eb423 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:56.977208 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-196d04a5-8194-4ccb-97b5-b2bace5eb423 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:57.275766 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-196d04a5-8194-4ccb-97b5-b2bace5eb423 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87b9f9f1adc4c2bb9da82df9d27802e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a0d4c968d84b02977004edf46cde48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:57.283129 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-196d04a5-8194-4ccb-97b5-b2bace5eb423 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] 10.222.0.43 "GET /compute/v2.1/servers/b468c753-6209-4dd0-bc03-2ca596237f8a" status: 200 len: 1319 microversion: 2.1 time: 0.321222 Jun 23 22:45:57.283682 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 448/918] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:56 2022] GET /compute/v2.1/servers/b468c753-6209-4dd0-bc03-2ca596237f8a => generated 1319 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:58.300055 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-8f50e962-9a64-4d5a-8a85-427b4b5e84c1 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:58.300674 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-8f50e962-9a64-4d5a-8a85-427b4b5e84c1 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] [instance: b468c753-6209-4dd0-bc03-2ca596237f8a] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:58.303355 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell0:SELECT=2 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:45:58.304185 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell0:SELECT=6 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:45:58.310505 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-8f50e962-9a64-4d5a-8a85-427b4b5e84c1 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:58.310982 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-8f50e962-9a64-4d5a-8a85-427b4b5e84c1 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:58.311746 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-8f50e962-9a64-4d5a-8a85-427b4b5e84c1 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:58.312182 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-8f50e962-9a64-4d5a-8a85-427b4b5e84c1 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:58.492409 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-8f50e962-9a64-4d5a-8a85-427b4b5e84c1 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87b9f9f1adc4c2bb9da82df9d27802e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a0d4c968d84b02977004edf46cde48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:58.500099 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-8f50e962-9a64-4d5a-8a85-427b4b5e84c1 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] 10.222.0.43 "GET /compute/v2.1/servers/b468c753-6209-4dd0-bc03-2ca596237f8a" status: 200 len: 1508 microversion: 2.1 time: 0.203918 Jun 23 22:45:58.500685 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 471/919] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:58 2022] GET /compute/v2.1/servers/b468c753-6209-4dd0-bc03-2ca596237f8a => generated 1508 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:58.516383 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-ae348663-f3d7-481c-932b-794956dfcd41 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91910b1c-e843-4bbc-be2d-5854d612bf71", "device": "/dev/sdb"}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:45:58.517944 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-ae348663-f3d7-481c-932b-794956dfcd41 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] [instance: b468c753-6209-4dd0-bc03-2ca596237f8a] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:58.524897 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ae348663-f3d7-481c-932b-794956dfcd41 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:58.525340 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ae348663-f3d7-481c-932b-794956dfcd41 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:58.526105 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ae348663-f3d7-481c-932b-794956dfcd41 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:58.526535 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ae348663-f3d7-481c-932b-794956dfcd41 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:58.764765 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-ae348663-f3d7-481c-932b-794956dfcd41 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] 10.222.0.43 "POST /compute/v2.1/servers/b468c753-6209-4dd0-bc03-2ca596237f8a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252119 Jun 23 22:45:58.765356 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 449/920] 10.222.0.43 () {60 vars in 1322 bytes} [Thu Jun 23 22:45:58 2022] POST /compute/v2.1/servers/b468c753-6209-4dd0-bc03-2ca596237f8a/os-volume_attachments => generated 194 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:46:00.291173 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-62903c1f-e18a-4b3d-a9db-6f6a6691cef4 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:00.291725 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-62903c1f-e18a-4b3d-a9db-6f6a6691cef4 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:00.298353 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-62903c1f-e18a-4b3d-a9db-6f6a6691cef4 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:00.298793 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-62903c1f-e18a-4b3d-a9db-6f6a6691cef4 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:00.299570 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-62903c1f-e18a-4b3d-a9db-6f6a6691cef4 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:00.299994 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-62903c1f-e18a-4b3d-a9db-6f6a6691cef4 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:00.325450 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-62903c1f-e18a-4b3d-a9db-6f6a6691cef4 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715/ips" status: 200 len: 150 microversion: 2.20 time: 0.038442 Jun 23 22:46:00.326003 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 472/921] 10.222.0.43 () {60 vars in 1288 bytes} [Thu Jun 23 22:46:00 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 22:46:02.671021 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-8ee28c26-7687-4355-a7e3-ab5546c72f65 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:46:02.671642 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-8ee28c26-7687-4355-a7e3-ab5546c72f65 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:02.678489 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8ee28c26-7687-4355-a7e3-ab5546c72f65 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:02.678944 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8ee28c26-7687-4355-a7e3-ab5546c72f65 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:02.679719 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8ee28c26-7687-4355-a7e3-ab5546c72f65 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:02.680150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8ee28c26-7687-4355-a7e3-ab5546c72f65 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:02.701822 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.objects.instance [None req-8ee28c26-7687-4355-a7e3-ab5546c72f65 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lazy-loading 'flavor' on Instance uuid fe4cae6a-0365-477a-bbcb-100245e62715 {{(pid=124358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:46:02.956309 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-8ee28c26-7687-4355-a7e3-ab5546c72f65 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "POST /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715/action" status: 202 len: 0 microversion: 2.20 time: 0.290123 Jun 23 22:46:02.957005 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 450/922] 10.222.0.43 () {62 vars in 1318 bytes} [Thu Jun 23 22:46:02 2022] POST /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 22:46:02.966606 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-782e62bc-da2b-4323-8822-5db2ba41d37e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:02.967253 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-782e62bc-da2b-4323-8822-5db2ba41d37e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:02.974939 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-782e62bc-da2b-4323-8822-5db2ba41d37e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:02.975563 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-782e62bc-da2b-4323-8822-5db2ba41d37e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:02.976378 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-782e62bc-da2b-4323-8822-5db2ba41d37e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:02.976809 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-782e62bc-da2b-4323-8822-5db2ba41d37e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:03.109908 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-782e62bc-da2b-4323-8822-5db2ba41d37e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:03.117870 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-782e62bc-da2b-4323-8822-5db2ba41d37e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:03.119446 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-782e62bc-da2b-4323-8822-5db2ba41d37e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:03.120601 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-782e62bc-da2b-4323-8822-5db2ba41d37e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1722 microversion: 2.20 time: 0.158128 Jun 23 22:46:03.121202 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 473/923] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:02 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:04.141183 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-9e57296d-29f0-46a4-b374-b6c15809d848 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:04.141887 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-9e57296d-29f0-46a4-b374-b6c15809d848 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:04.148657 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9e57296d-29f0-46a4-b374-b6c15809d848 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:04.149103 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9e57296d-29f0-46a4-b374-b6c15809d848 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:04.149865 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9e57296d-29f0-46a4-b374-b6c15809d848 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:04.150298 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9e57296d-29f0-46a4-b374-b6c15809d848 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:04.281000 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-9e57296d-29f0-46a4-b374-b6c15809d848 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:04.289638 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-9e57296d-29f0-46a4-b374-b6c15809d848 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:04.291180 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-9e57296d-29f0-46a4-b374-b6c15809d848 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:04.292337 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-9e57296d-29f0-46a4-b374-b6c15809d848 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1722 microversion: 2.20 time: 0.155986 Jun 23 22:46:04.292885 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 451/924] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:04 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:05.311544 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-d7187945-a852-4cc3-9c9f-c384eaf853e0 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:05.312205 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-d7187945-a852-4cc3-9c9f-c384eaf853e0 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:05.319614 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d7187945-a852-4cc3-9c9f-c384eaf853e0 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:05.320056 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d7187945-a852-4cc3-9c9f-c384eaf853e0 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:05.320814 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d7187945-a852-4cc3-9c9f-c384eaf853e0 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:05.321264 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d7187945-a852-4cc3-9c9f-c384eaf853e0 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:05.451175 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-d7187945-a852-4cc3-9c9f-c384eaf853e0 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:05.459075 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-d7187945-a852-4cc3-9c9f-c384eaf853e0 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:05.460568 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-d7187945-a852-4cc3-9c9f-c384eaf853e0 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:05.461707 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-d7187945-a852-4cc3-9c9f-c384eaf853e0 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1722 microversion: 2.20 time: 0.154141 Jun 23 22:46:05.462265 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 474/925] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:05 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:06.480349 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-7fb31556-0ecf-4737-aed7-80c9338ad6cf tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:06.480964 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-7fb31556-0ecf-4737-aed7-80c9338ad6cf tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:06.487670 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7fb31556-0ecf-4737-aed7-80c9338ad6cf tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:06.488165 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7fb31556-0ecf-4737-aed7-80c9338ad6cf tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:06.489005 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7fb31556-0ecf-4737-aed7-80c9338ad6cf tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:06.489500 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7fb31556-0ecf-4737-aed7-80c9338ad6cf tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:06.620937 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-7fb31556-0ecf-4737-aed7-80c9338ad6cf tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:06.628766 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-7fb31556-0ecf-4737-aed7-80c9338ad6cf tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:06.631148 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-7fb31556-0ecf-4737-aed7-80c9338ad6cf tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:06.632388 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-7fb31556-0ecf-4737-aed7-80c9338ad6cf tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1722 microversion: 2.20 time: 0.156023 Jun 23 22:46:06.632981 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 452/926] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:06 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:07.650978 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-90670b20-4ff7-44bf-b169-5079b971971e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:07.651531 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-90670b20-4ff7-44bf-b169-5079b971971e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:07.657903 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-90670b20-4ff7-44bf-b169-5079b971971e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:07.658325 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-90670b20-4ff7-44bf-b169-5079b971971e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:07.659103 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-90670b20-4ff7-44bf-b169-5079b971971e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:07.659530 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-90670b20-4ff7-44bf-b169-5079b971971e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:07.790094 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-90670b20-4ff7-44bf-b169-5079b971971e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:07.798263 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-90670b20-4ff7-44bf-b169-5079b971971e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:07.799781 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-90670b20-4ff7-44bf-b169-5079b971971e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:07.800923 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-90670b20-4ff7-44bf-b169-5079b971971e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1722 microversion: 2.20 time: 0.153947 Jun 23 22:46:07.801475 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 475/927] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:07 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:08.818744 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-af126bb8-3966-4247-a07a-a0d8f563537f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:08.819418 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-af126bb8-3966-4247-a07a-a0d8f563537f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:08.825899 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-af126bb8-3966-4247-a07a-a0d8f563537f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:08.826344 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-af126bb8-3966-4247-a07a-a0d8f563537f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:08.827123 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-af126bb8-3966-4247-a07a-a0d8f563537f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:08.827542 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-af126bb8-3966-4247-a07a-a0d8f563537f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:08.954707 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-af126bb8-3966-4247-a07a-a0d8f563537f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:08.963505 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-af126bb8-3966-4247-a07a-a0d8f563537f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:08.965001 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-af126bb8-3966-4247-a07a-a0d8f563537f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:08.966150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-af126bb8-3966-4247-a07a-a0d8f563537f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1722 microversion: 2.20 time: 0.151734 Jun 23 22:46:08.966695 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 453/928] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:08 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:46:09.985585 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-1d33ed92-f83f-4e12-884b-7665228adf5b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:09.986177 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-1d33ed92-f83f-4e12-884b-7665228adf5b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:09.993101 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1d33ed92-f83f-4e12-884b-7665228adf5b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:09.993544 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1d33ed92-f83f-4e12-884b-7665228adf5b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:09.994302 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1d33ed92-f83f-4e12-884b-7665228adf5b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:09.994738 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1d33ed92-f83f-4e12-884b-7665228adf5b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:10.126691 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-1d33ed92-f83f-4e12-884b-7665228adf5b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:10.135445 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-1d33ed92-f83f-4e12-884b-7665228adf5b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:10.136947 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-1d33ed92-f83f-4e12-884b-7665228adf5b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:10.138104 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-1d33ed92-f83f-4e12-884b-7665228adf5b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1722 microversion: 2.20 time: 0.156434 Jun 23 22:46:10.138666 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 476/929] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:09 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:11.157102 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-6f9c6b23-431f-4e7e-bfaf-a805e2122520 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:11.157758 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-6f9c6b23-431f-4e7e-bfaf-a805e2122520 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:11.164873 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6f9c6b23-431f-4e7e-bfaf-a805e2122520 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:11.165318 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6f9c6b23-431f-4e7e-bfaf-a805e2122520 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:11.166082 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6f9c6b23-431f-4e7e-bfaf-a805e2122520 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:11.166513 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6f9c6b23-431f-4e7e-bfaf-a805e2122520 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:11.291092 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-6f9c6b23-431f-4e7e-bfaf-a805e2122520 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:11.299274 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-6f9c6b23-431f-4e7e-bfaf-a805e2122520 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:11.300812 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-6f9c6b23-431f-4e7e-bfaf-a805e2122520 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:11.301973 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-6f9c6b23-431f-4e7e-bfaf-a805e2122520 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1722 microversion: 2.20 time: 0.148819 Jun 23 22:46:11.302526 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 454/930] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:11 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:46:12.321053 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-6ecc03ce-b8bb-4fa3-a467-577570d9504e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:12.321694 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-6ecc03ce-b8bb-4fa3-a467-577570d9504e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:12.328249 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6ecc03ce-b8bb-4fa3-a467-577570d9504e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:12.328713 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6ecc03ce-b8bb-4fa3-a467-577570d9504e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:12.329480 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6ecc03ce-b8bb-4fa3-a467-577570d9504e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:12.329895 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6ecc03ce-b8bb-4fa3-a467-577570d9504e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:12.464924 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-6ecc03ce-b8bb-4fa3-a467-577570d9504e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:12.472865 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-6ecc03ce-b8bb-4fa3-a467-577570d9504e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:12.474703 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-6ecc03ce-b8bb-4fa3-a467-577570d9504e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:12.475883 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-6ecc03ce-b8bb-4fa3-a467-577570d9504e tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1722 microversion: 2.20 time: 0.159385 Jun 23 22:46:12.476439 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 477/931] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:12 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:13.494045 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-4d08aa14-da1c-405f-ae55-bd475ce6e704 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:13.494675 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-4d08aa14-da1c-405f-ae55-bd475ce6e704 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:13.501510 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4d08aa14-da1c-405f-ae55-bd475ce6e704 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:13.501952 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4d08aa14-da1c-405f-ae55-bd475ce6e704 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:13.502710 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4d08aa14-da1c-405f-ae55-bd475ce6e704 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:13.503171 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4d08aa14-da1c-405f-ae55-bd475ce6e704 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:13.633055 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4d08aa14-da1c-405f-ae55-bd475ce6e704 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:13.641086 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4d08aa14-da1c-405f-ae55-bd475ce6e704 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:13.642591 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4d08aa14-da1c-405f-ae55-bd475ce6e704 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:13.643754 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-4d08aa14-da1c-405f-ae55-bd475ce6e704 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1722 microversion: 2.20 time: 0.153631 Jun 23 22:46:13.644302 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 455/932] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:13 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:14.662676 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-389e6a19-d93f-4f33-9a54-a2d7651138bc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:14.663309 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-389e6a19-d93f-4f33-9a54-a2d7651138bc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:14.670001 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-389e6a19-d93f-4f33-9a54-a2d7651138bc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:14.670446 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-389e6a19-d93f-4f33-9a54-a2d7651138bc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:14.671234 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-389e6a19-d93f-4f33-9a54-a2d7651138bc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:14.671667 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-389e6a19-d93f-4f33-9a54-a2d7651138bc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:14.800043 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-389e6a19-d93f-4f33-9a54-a2d7651138bc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:14.809236 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-389e6a19-d93f-4f33-9a54-a2d7651138bc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:14.811027 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-389e6a19-d93f-4f33-9a54-a2d7651138bc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:14.812559 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-389e6a19-d93f-4f33-9a54-a2d7651138bc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1722 microversion: 2.20 time: 0.154297 Jun 23 22:46:14.813304 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 478/933] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:14 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:15.831465 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-016bab34-fcf3-471e-b17c-52ac4d7026d1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:15.832200 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-016bab34-fcf3-471e-b17c-52ac4d7026d1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:15.839071 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-016bab34-fcf3-471e-b17c-52ac4d7026d1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:15.839509 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-016bab34-fcf3-471e-b17c-52ac4d7026d1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:15.840255 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-016bab34-fcf3-471e-b17c-52ac4d7026d1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:15.840678 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-016bab34-fcf3-471e-b17c-52ac4d7026d1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:15.976628 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-016bab34-fcf3-471e-b17c-52ac4d7026d1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:15.984500 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-016bab34-fcf3-471e-b17c-52ac4d7026d1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:15.985972 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-016bab34-fcf3-471e-b17c-52ac4d7026d1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:15.987147 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-016bab34-fcf3-471e-b17c-52ac4d7026d1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1722 microversion: 2.20 time: 0.159510 Jun 23 22:46:15.987694 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 456/934] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:15 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:17.005893 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-1518e5dd-51d6-4194-abcb-40d5a80ae5d8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:17.006502 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-1518e5dd-51d6-4194-abcb-40d5a80ae5d8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:17.008823 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:46:17.014529 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1518e5dd-51d6-4194-abcb-40d5a80ae5d8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:17.014996 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1518e5dd-51d6-4194-abcb-40d5a80ae5d8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:17.015893 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1518e5dd-51d6-4194-abcb-40d5a80ae5d8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:17.016449 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1518e5dd-51d6-4194-abcb-40d5a80ae5d8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:17.021950 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell1:SELECT=81 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:46:17.148314 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-1518e5dd-51d6-4194-abcb-40d5a80ae5d8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:17.156726 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-1518e5dd-51d6-4194-abcb-40d5a80ae5d8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:17.158328 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-1518e5dd-51d6-4194-abcb-40d5a80ae5d8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:17.159630 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-1518e5dd-51d6-4194-abcb-40d5a80ae5d8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1722 microversion: 2.20 time: 0.158064 Jun 23 22:46:17.160245 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 479/935] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:17 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:18.079504 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-712253b2-51de-4fe0-ade8-7f3abc95398a tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:18.079992 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-712253b2-51de-4fe0-ade8-7f3abc95398a tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] [instance: b468c753-6209-4dd0-bc03-2ca596237f8a] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:18.082363 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=31 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:46:18.087816 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-712253b2-51de-4fe0-ade8-7f3abc95398a tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:18.088248 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-712253b2-51de-4fe0-ade8-7f3abc95398a tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:18.088998 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-712253b2-51de-4fe0-ade8-7f3abc95398a tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:18.089483 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-712253b2-51de-4fe0-ade8-7f3abc95398a tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:18.092139 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:46:18.171607 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.objects.instance [None req-712253b2-51de-4fe0-ade8-7f3abc95398a tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lazy-loading 'services' on Instance uuid b468c753-6209-4dd0-bc03-2ca596237f8a {{(pid=124358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:46:18.180155 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-1e650242-9f6a-47aa-9f0d-bddeef915ba1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:18.180872 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-1e650242-9f6a-47aa-9f0d-bddeef915ba1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:18.187301 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1e650242-9f6a-47aa-9f0d-bddeef915ba1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:18.187807 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1e650242-9f6a-47aa-9f0d-bddeef915ba1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:18.188646 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1e650242-9f6a-47aa-9f0d-bddeef915ba1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:18.189139 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1e650242-9f6a-47aa-9f0d-bddeef915ba1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:18.246211 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-712253b2-51de-4fe0-ade8-7f3abc95398a tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b468c753-6209-4dd0-bc03-2ca596237f8a/os-volume_attachments/91910b1c-e843-4bbc-be2d-5854d612bf71" status: 202 len: 0 microversion: 2.1 time: 0.170338 Jun 23 22:46:18.246828 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 457/936] 10.222.0.43 () {58 vars in 1415 bytes} [Thu Jun 23 22:46:18 2022] DELETE /compute/v2.1/servers/b468c753-6209-4dd0-bc03-2ca596237f8a/os-volume_attachments/91910b1c-e843-4bbc-be2d-5854d612bf71 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:46:18.344504 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-1e650242-9f6a-47aa-9f0d-bddeef915ba1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:18.353747 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-1e650242-9f6a-47aa-9f0d-bddeef915ba1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:18.355287 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-1e650242-9f6a-47aa-9f0d-bddeef915ba1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:18.356442 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-1e650242-9f6a-47aa-9f0d-bddeef915ba1 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1722 microversion: 2.20 time: 0.180701 Jun 23 22:46:18.357001 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 480/937] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:18 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:46:19.364721 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-24af193b-777b-42dc-a02a-64b4c0a3988e tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:19.365307 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-24af193b-777b-42dc-a02a-64b4c0a3988e tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] [instance: b468c753-6209-4dd0-bc03-2ca596237f8a] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:19.371519 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-24af193b-777b-42dc-a02a-64b4c0a3988e tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:19.371962 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-24af193b-777b-42dc-a02a-64b4c0a3988e tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:19.372721 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-24af193b-777b-42dc-a02a-64b4c0a3988e tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:19.373154 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-24af193b-777b-42dc-a02a-64b4c0a3988e tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:19.375718 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-6d10ba4f-a17a-4f28-81cb-577775a29f2d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:19.376320 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-6d10ba4f-a17a-4f28-81cb-577775a29f2d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:19.382524 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6d10ba4f-a17a-4f28-81cb-577775a29f2d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:19.382900 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6d10ba4f-a17a-4f28-81cb-577775a29f2d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:19.383671 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6d10ba4f-a17a-4f28-81cb-577775a29f2d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:19.384096 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-6d10ba4f-a17a-4f28-81cb-577775a29f2d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:19.399636 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-24af193b-777b-42dc-a02a-64b4c0a3988e tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] [instance: b468c753-6209-4dd0-bc03-2ca596237f8a] Going to try to terminate instance {{(pid=124358) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:46:19.484986 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-24af193b-777b-42dc-a02a-64b4c0a3988e tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b468c753-6209-4dd0-bc03-2ca596237f8a" status: 204 len: 0 microversion: 2.1 time: 0.124939 Jun 23 22:46:19.485653 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 458/938] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 23 22:46:19 2022] DELETE /compute/v2.1/servers/b468c753-6209-4dd0-bc03-2ca596237f8a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 22:46:19.495087 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-dc0ee20f-9059-4e64-af3f-97b680c00bfc tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:19.495762 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-dc0ee20f-9059-4e64-af3f-97b680c00bfc tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] [instance: b468c753-6209-4dd0-bc03-2ca596237f8a] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:19.501616 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-dc0ee20f-9059-4e64-af3f-97b680c00bfc tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:19.502057 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-dc0ee20f-9059-4e64-af3f-97b680c00bfc tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:19.502819 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-dc0ee20f-9059-4e64-af3f-97b680c00bfc tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:19.503281 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-dc0ee20f-9059-4e64-af3f-97b680c00bfc tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:19.521668 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-6d10ba4f-a17a-4f28-81cb-577775a29f2d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:19.530316 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-6d10ba4f-a17a-4f28-81cb-577775a29f2d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:19.531833 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-6d10ba4f-a17a-4f28-81cb-577775a29f2d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:19.532980 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-6d10ba4f-a17a-4f28-81cb-577775a29f2d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1722 microversion: 2.20 time: 0.161517 Jun 23 22:46:19.533538 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 481/939] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:19 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:46:19.637783 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-dc0ee20f-9059-4e64-af3f-97b680c00bfc tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87b9f9f1adc4c2bb9da82df9d27802e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a0d4c968d84b02977004edf46cde48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:19.645483 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-dc0ee20f-9059-4e64-af3f-97b680c00bfc tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] 10.222.0.43 "GET /compute/v2.1/servers/b468c753-6209-4dd0-bc03-2ca596237f8a" status: 200 len: 1514 microversion: 2.1 time: 0.154316 Jun 23 22:46:19.646160 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 459/940] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:19 2022] GET /compute/v2.1/servers/b468c753-6209-4dd0-bc03-2ca596237f8a => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:46:20.553066 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-160bdc28-560c-4515-9604-2f610d4dc012 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:20.553779 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-160bdc28-560c-4515-9604-2f610d4dc012 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:20.560330 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-160bdc28-560c-4515-9604-2f610d4dc012 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:20.560768 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-160bdc28-560c-4515-9604-2f610d4dc012 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:20.561516 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-160bdc28-560c-4515-9604-2f610d4dc012 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:20.561940 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-160bdc28-560c-4515-9604-2f610d4dc012 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:20.662648 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-cd3b530f-dfa5-4818-bf54-01d1bab957a4 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:20.663295 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-cd3b530f-dfa5-4818-bf54-01d1bab957a4 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] [instance: b468c753-6209-4dd0-bc03-2ca596237f8a] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:20.669958 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cd3b530f-dfa5-4818-bf54-01d1bab957a4 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:20.670416 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cd3b530f-dfa5-4818-bf54-01d1bab957a4 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:20.671208 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cd3b530f-dfa5-4818-bf54-01d1bab957a4 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:20.671643 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cd3b530f-dfa5-4818-bf54-01d1bab957a4 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:20.694196 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-160bdc28-560c-4515-9604-2f610d4dc012 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:20.702193 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-160bdc28-560c-4515-9604-2f610d4dc012 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:20.703737 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-160bdc28-560c-4515-9604-2f610d4dc012 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:20.704904 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-160bdc28-560c-4515-9604-2f610d4dc012 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1722 microversion: 2.20 time: 0.155997 Jun 23 22:46:20.705467 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 482/941] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:20 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:46:20.800809 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-cd3b530f-dfa5-4818-bf54-01d1bab957a4 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87b9f9f1adc4c2bb9da82df9d27802e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a0d4c968d84b02977004edf46cde48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:20.808876 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-cd3b530f-dfa5-4818-bf54-01d1bab957a4 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] 10.222.0.43 "GET /compute/v2.1/servers/b468c753-6209-4dd0-bc03-2ca596237f8a" status: 200 len: 1514 microversion: 2.1 time: 0.150591 Jun 23 22:46:20.809426 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 460/942] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:20 2022] GET /compute/v2.1/servers/b468c753-6209-4dd0-bc03-2ca596237f8a => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:46:21.690184 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [req-707f0b66-cfc1-4244-be2b-af8ad5f0dc76 req-af8a356e-5798-4f61-a20e-4ea9cd71606e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b468c753-6209-4dd0-bc03-2ca596237f8a", "name": "network-vif-deleted", "tag": "a6e2f94a-c00b-44da-b961-092c392efbfb"}]} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:46:21.703207 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-707f0b66-cfc1-4244-be2b-af8ad5f0dc76 req-af8a356e-5798-4f61-a20e-4ea9cd71606e service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:21.703891 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-707f0b66-cfc1-4244-be2b-af8ad5f0dc76 req-af8a356e-5798-4f61-a20e-4ea9cd71606e service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:21.717085 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.compute.server_external_events [req-707f0b66-cfc1-4244-be2b-af8ad5f0dc76 req-af8a356e-5798-4f61-a20e-4ea9cd71606e service nova] Creating event network-vif-deleted:a6e2f94a-c00b-44da-b961-092c392efbfb for instance b468c753-6209-4dd0-bc03-2ca596237f8a on hv-cinder-84617 Jun 23 22:46:21.722599 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [req-707f0b66-cfc1-4244-be2b-af8ad5f0dc76 req-af8a356e-5798-4f61-a20e-4ea9cd71606e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036541 Jun 23 22:46:21.723991 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-59b8e9ed-33d8-4516-a95c-6de58aaacf37 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:21.724942 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 483/943] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:46:21.725085 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-59b8e9ed-33d8-4516-a95c-6de58aaacf37 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:21.731646 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-59b8e9ed-33d8-4516-a95c-6de58aaacf37 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:21.732226 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-59b8e9ed-33d8-4516-a95c-6de58aaacf37 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:21.732998 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-59b8e9ed-33d8-4516-a95c-6de58aaacf37 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:21.733430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-59b8e9ed-33d8-4516-a95c-6de58aaacf37 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:21.826523 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-17cbbc20-5430-4929-b682-29d864c03f09 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:21.827277 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-17cbbc20-5430-4929-b682-29d864c03f09 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] [instance: b468c753-6209-4dd0-bc03-2ca596237f8a] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:21.834757 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-17cbbc20-5430-4929-b682-29d864c03f09 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:21.835227 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-17cbbc20-5430-4929-b682-29d864c03f09 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:21.835999 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-17cbbc20-5430-4929-b682-29d864c03f09 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:21.836435 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-17cbbc20-5430-4929-b682-29d864c03f09 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:21.869298 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-17cbbc20-5430-4929-b682-29d864c03f09 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:21.869670 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-17cbbc20-5430-4929-b682-29d864c03f09 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:21.870119 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.objects.instance [None req-17cbbc20-5430-4929-b682-29d864c03f09 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lazy-loading 'fault' on Instance uuid b468c753-6209-4dd0-bc03-2ca596237f8a {{(pid=124357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:46:21.871540 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-59b8e9ed-33d8-4516-a95c-6de58aaacf37 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:21.880784 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-59b8e9ed-33d8-4516-a95c-6de58aaacf37 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:21.882320 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-59b8e9ed-33d8-4516-a95c-6de58aaacf37 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:21.883596 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-59b8e9ed-33d8-4516-a95c-6de58aaacf37 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1722 microversion: 2.20 time: 0.164170 Jun 23 22:46:21.884331 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 461/944] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:21 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:46:21.912742 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-17cbbc20-5430-4929-b682-29d864c03f09 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f87b9f9f1adc4c2bb9da82df9d27802e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65a0d4c968d84b02977004edf46cde48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:21.920730 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-17cbbc20-5430-4929-b682-29d864c03f09 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] 10.222.0.43 "GET /compute/v2.1/servers/b468c753-6209-4dd0-bc03-2ca596237f8a" status: 200 len: 1309 microversion: 2.1 time: 0.098699 Jun 23 22:46:21.921302 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 484/945] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:21 2022] GET /compute/v2.1/servers/b468c753-6209-4dd0-bc03-2ca596237f8a => generated 1309 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:22.901659 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-6bd841d2-98d0-4651-8189-5c0c2a9b4ffc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:22.902295 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-6bd841d2-98d0-4651-8189-5c0c2a9b4ffc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:22.908704 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6bd841d2-98d0-4651-8189-5c0c2a9b4ffc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:22.909142 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6bd841d2-98d0-4651-8189-5c0c2a9b4ffc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:22.910035 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6bd841d2-98d0-4651-8189-5c0c2a9b4ffc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:22.911034 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6bd841d2-98d0-4651-8189-5c0c2a9b4ffc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:22.939013 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-3af6f4db-4244-4568-b4b7-e11b154608a6 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:22.939668 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-3af6f4db-4244-4568-b4b7-e11b154608a6 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] [instance: b468c753-6209-4dd0-bc03-2ca596237f8a] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:22.946432 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3af6f4db-4244-4568-b4b7-e11b154608a6 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:22.946882 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3af6f4db-4244-4568-b4b7-e11b154608a6 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:22.947711 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3af6f4db-4244-4568-b4b7-e11b154608a6 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:22.948180 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3af6f4db-4244-4568-b4b7-e11b154608a6 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:22.964045 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.wsgi [None req-3af6f4db-4244-4568-b4b7-e11b154608a6 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] HTTP exception thrown: Instance b468c753-6209-4dd0-bc03-2ca596237f8a could not be found. Jun 23 22:46:22.965707 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-3af6f4db-4244-4568-b4b7-e11b154608a6 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Request method failure captured: Jun 23 22:46:22.965707 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: request: GET /compute/v2.1/servers/b468c753-6209-4dd0-bc03-2ca596237f8a HTTP/1.1 Jun 23 22:46:22.965707 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept: application/json Jun 23 22:46:22.965707 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept-Encoding: identity Jun 23 22:46:22.965707 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Connection: close Jun 23 22:46:22.965707 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Length: 0 Jun 23 22:46:22.965707 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Type: application/json Jun 23 22:46:22.965707 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Host: 10.222.0.43 Jun 23 22:46:22.965707 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Openstack-System-Scope: None Jun 23 22:46:22.965707 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: User-Agent: python-urllib3/1.26.9 Jun 23 22:46:22.965707 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Auth-Token: gAAAAABitOzRi2ndElzubFVUu4IRhFkM2HT4hxiXS_UEWDlTrGyPaYaOb21npGnFOLxXNMZTMZKHyAVOlK1FqcOkSu_7W-l-1di4h1qoJD68B5Qw16IM1bJZa7So3s4-gJhGQExN_MTfZ1N5ZFdKxxwepBlpbKVyZi8of2RINRo3y28tWtR4dvo Jun 23 22:46:22.965707 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Id: None Jun 23 22:46:22.965707 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Name: None Jun 23 22:46:22.965707 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Identity-Status: Confirmed Jun 23 22:46:22.965707 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Is-Admin-Project: True Jun 23 22:46:22.965707 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Id: default Jun 23 22:46:22.965707 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Name: Default Jun 23 22:46:22.965707 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Id: 65a0d4c968d84b02977004edf46cde48 Jun 23 22:46:22.965707 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1117270034 Jun 23 22:46:22.965707 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Role: reader,member Jun 23 22:46:22.965707 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Roles: reader,member Jun 23 22:46:22.967483 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/65a0d4c968d84b02977004edf46cde48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/65a0d4c968d84b02977004edf46cde48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_65a0d4c968d84b02977004edf46cde48", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/65a0d4c968d84b02977004edf46cde48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:46:22.967483 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant: tempest-VolumesSnapshotTestJSON-1117270034 Jun 23 22:46:22.967483 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Id: 65a0d4c968d84b02977004edf46cde48 Jun 23 22:46:22.967483 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1117270034 Jun 23 22:46:22.967483 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User: tempest-VolumesSnapshotTestJSON-1117270034-project Jun 23 22:46:22.967483 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Id: default Jun 23 22:46:22.967483 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Name: Default Jun 23 22:46:22.967483 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Id: f87b9f9f1adc4c2bb9da82df9d27802e Jun 23 22:46:22.967483 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Name: tempest-VolumesSnapshotTestJSON-1117270034-project Jun 23 22:46:22.967483 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: method: > Jun 23 22:46:22.967483 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: exception: Instance b468c753-6209-4dd0-bc03-2ca596237f8a could not be found. Jun 23 22:46:22.967483 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: action_args: {'id': 'b468c753-6209-4dd0-bc03-2ca596237f8a'} Jun 23 22:46:22.968407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:46:22.968407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:46:22.968407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:46:22.968407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:46:22.968407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:46:22.968407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:46:22.968407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:46:22.968407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:46:22.968407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:46:22.968407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:46:22.968407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b468c753-6209-4dd0-bc03-2ca596237f8a could not be found. Jun 23 22:46:22.968407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:46:22.968407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:46:22.968407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:46:22.968407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:46:22.968407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:46:22.968407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:46:22.968407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:46:22.968407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:46:22.968407 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:46:22.969824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:46:22.969824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:46:22.969824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:46:22.969824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:46:22.969824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:46:22.969824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:46:22.969824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:46:22.969824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b468c753-6209-4dd0-bc03-2ca596237f8a could not be found. Jun 23 22:46:22.969824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:46:22.969824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:46:22.969824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:46:22.969824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:46:22.969824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:46:22.969824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:46:22.969824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:46:22.969824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:46:22.969824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b468c753-6209-4dd0-bc03-2ca596237f8a could not be found. Jun 23 22:46:22.969824 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:46:22.971976 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-3af6f4db-4244-4568-b4b7-e11b154608a6 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] Returning 404 to user: Instance b468c753-6209-4dd0-bc03-2ca596237f8a could not be found. {{(pid=124357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:46:22.971976 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-3af6f4db-4244-4568-b4b7-e11b154608a6 tempest-VolumesSnapshotTestJSON-1117270034 tempest-VolumesSnapshotTestJSON-1117270034-project] 10.222.0.43 "GET /compute/v2.1/servers/b468c753-6209-4dd0-bc03-2ca596237f8a" status: 404 len: 111 microversion: 2.1 time: 0.032149 Jun 23 22:46:22.971976 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 485/946] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:22 2022] GET /compute/v2.1/servers/b468c753-6209-4dd0-bc03-2ca596237f8a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 22:46:23.049778 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-6bd841d2-98d0-4651-8189-5c0c2a9b4ffc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:23.058788 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-6bd841d2-98d0-4651-8189-5c0c2a9b4ffc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:23.060329 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-6bd841d2-98d0-4651-8189-5c0c2a9b4ffc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:23.061479 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-6bd841d2-98d0-4651-8189-5c0c2a9b4ffc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1722 microversion: 2.20 time: 0.163737 Jun 23 22:46:23.062023 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 462/947] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:22 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:24.079775 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-be45b456-0cc6-4408-9c2a-c73aa3f12a91 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:24.080363 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-be45b456-0cc6-4408-9c2a-c73aa3f12a91 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:24.087766 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-be45b456-0cc6-4408-9c2a-c73aa3f12a91 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:24.088200 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-be45b456-0cc6-4408-9c2a-c73aa3f12a91 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:24.088955 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-be45b456-0cc6-4408-9c2a-c73aa3f12a91 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:24.089379 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-be45b456-0cc6-4408-9c2a-c73aa3f12a91 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:24.368061 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-be45b456-0cc6-4408-9c2a-c73aa3f12a91 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:24.376078 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-be45b456-0cc6-4408-9c2a-c73aa3f12a91 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:24.377679 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-be45b456-0cc6-4408-9c2a-c73aa3f12a91 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:24.378904 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-be45b456-0cc6-4408-9c2a-c73aa3f12a91 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1743 microversion: 2.20 time: 0.302996 Jun 23 22:46:24.380104 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 486/948] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:24 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1743 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:25.398851 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-aded3514-ca16-4d86-a669-64c08b274f9b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:25.399431 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-aded3514-ca16-4d86-a669-64c08b274f9b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:25.405921 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-aded3514-ca16-4d86-a669-64c08b274f9b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:25.406362 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-aded3514-ca16-4d86-a669-64c08b274f9b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:25.407164 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-aded3514-ca16-4d86-a669-64c08b274f9b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:25.407598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-aded3514-ca16-4d86-a669-64c08b274f9b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:25.538078 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-aded3514-ca16-4d86-a669-64c08b274f9b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:25.546249 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-aded3514-ca16-4d86-a669-64c08b274f9b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:25.547771 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-aded3514-ca16-4d86-a669-64c08b274f9b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:25.548914 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-aded3514-ca16-4d86-a669-64c08b274f9b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1743 microversion: 2.20 time: 0.154593 Jun 23 22:46:25.549456 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 463/949] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:25 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:26.568438 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-f51ee9e2-7843-4626-a658-3a55e2ae41c9 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:26.569110 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-f51ee9e2-7843-4626-a658-3a55e2ae41c9 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:26.575561 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f51ee9e2-7843-4626-a658-3a55e2ae41c9 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:26.575998 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f51ee9e2-7843-4626-a658-3a55e2ae41c9 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:26.576742 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f51ee9e2-7843-4626-a658-3a55e2ae41c9 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:26.577167 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f51ee9e2-7843-4626-a658-3a55e2ae41c9 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:26.703050 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-f51ee9e2-7843-4626-a658-3a55e2ae41c9 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:26.711744 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-f51ee9e2-7843-4626-a658-3a55e2ae41c9 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:26.713234 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-f51ee9e2-7843-4626-a658-3a55e2ae41c9 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:26.714386 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-f51ee9e2-7843-4626-a658-3a55e2ae41c9 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1743 microversion: 2.20 time: 0.150429 Jun 23 22:46:26.714940 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 487/950] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:26 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1743 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:27.733090 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-de19209d-a6cb-4a58-ab48-2458804bebd6 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:27.733700 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-de19209d-a6cb-4a58-ab48-2458804bebd6 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:27.740495 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-de19209d-a6cb-4a58-ab48-2458804bebd6 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:27.740936 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-de19209d-a6cb-4a58-ab48-2458804bebd6 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:27.741709 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-de19209d-a6cb-4a58-ab48-2458804bebd6 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:27.742125 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-de19209d-a6cb-4a58-ab48-2458804bebd6 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:27.876072 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-de19209d-a6cb-4a58-ab48-2458804bebd6 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:27.885198 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-de19209d-a6cb-4a58-ab48-2458804bebd6 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:27.886698 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-de19209d-a6cb-4a58-ab48-2458804bebd6 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:27.887886 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-de19209d-a6cb-4a58-ab48-2458804bebd6 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1743 microversion: 2.20 time: 0.158670 Jun 23 22:46:27.888646 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 464/951] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:27 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:28.907064 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-9175990b-e394-4143-9b5a-d15b004a84da tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:28.911198 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-9175990b-e394-4143-9b5a-d15b004a84da tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:28.919216 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9175990b-e394-4143-9b5a-d15b004a84da tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:28.920454 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9175990b-e394-4143-9b5a-d15b004a84da tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:28.921727 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9175990b-e394-4143-9b5a-d15b004a84da tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:28.922325 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9175990b-e394-4143-9b5a-d15b004a84da tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:29.075965 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-9175990b-e394-4143-9b5a-d15b004a84da tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:29.084693 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-9175990b-e394-4143-9b5a-d15b004a84da tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:29.086220 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-9175990b-e394-4143-9b5a-d15b004a84da tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:29.087647 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-9175990b-e394-4143-9b5a-d15b004a84da tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1738 microversion: 2.20 time: 0.185153 Jun 23 22:46:29.090991 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 488/952] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:28 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1738 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:30.065452 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-a25c6f0c-4cd1-4850-94d0-ff6ab4601053 req-f8a90b8a-1369-4826-917a-82322d562291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe4cae6a-0365-477a-bbcb-100245e62715", "name": "network-vif-plugged", "status": "completed", "tag": "ca42cad6-fa77-4fa7-b9e0-48ce41a63154"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:46:30.076346 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-a25c6f0c-4cd1-4850-94d0-ff6ab4601053 req-f8a90b8a-1369-4826-917a-82322d562291 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:30.076997 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-a25c6f0c-4cd1-4850-94d0-ff6ab4601053 req-f8a90b8a-1369-4826-917a-82322d562291 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:30.092533 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-a25c6f0c-4cd1-4850-94d0-ff6ab4601053 req-f8a90b8a-1369-4826-917a-82322d562291 service nova] Creating event network-vif-plugged:ca42cad6-fa77-4fa7-b9e0-48ce41a63154 for instance fe4cae6a-0365-477a-bbcb-100245e62715 on hv-cinder-84617 Jun 23 22:46:30.101401 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-a25c6f0c-4cd1-4850-94d0-ff6ab4601053 req-f8a90b8a-1369-4826-917a-82322d562291 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040194 Jun 23 22:46:30.102608 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 465/953] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:46:30.108030 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-46dd9eff-cbee-4d46-b56e-40f30d6c3553 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:30.109040 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-46dd9eff-cbee-4d46-b56e-40f30d6c3553 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:30.122781 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-46dd9eff-cbee-4d46-b56e-40f30d6c3553 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:30.123498 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-46dd9eff-cbee-4d46-b56e-40f30d6c3553 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:30.124504 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-46dd9eff-cbee-4d46-b56e-40f30d6c3553 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:30.126474 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-46dd9eff-cbee-4d46-b56e-40f30d6c3553 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:30.308354 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-46dd9eff-cbee-4d46-b56e-40f30d6c3553 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:30.319587 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-46dd9eff-cbee-4d46-b56e-40f30d6c3553 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:30.321177 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-46dd9eff-cbee-4d46-b56e-40f30d6c3553 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:30.322477 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-46dd9eff-cbee-4d46-b56e-40f30d6c3553 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1738 microversion: 2.20 time: 0.218900 Jun 23 22:46:30.323445 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 489/954] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:30 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1738 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:31.345029 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f3f45542-32c9-4690-9a2d-3c70f29df0c7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:31.346159 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-f3f45542-32c9-4690-9a2d-3c70f29df0c7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:31.355275 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f3f45542-32c9-4690-9a2d-3c70f29df0c7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:31.355991 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f3f45542-32c9-4690-9a2d-3c70f29df0c7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:31.357039 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f3f45542-32c9-4690-9a2d-3c70f29df0c7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:31.357579 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f3f45542-32c9-4690-9a2d-3c70f29df0c7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:31.540661 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f3f45542-32c9-4690-9a2d-3c70f29df0c7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:31.566577 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f3f45542-32c9-4690-9a2d-3c70f29df0c7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:31.570033 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f3f45542-32c9-4690-9a2d-3c70f29df0c7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:31.572301 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f3f45542-32c9-4690-9a2d-3c70f29df0c7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1738 microversion: 2.20 time: 0.233770 Jun 23 22:46:31.573363 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 466/955] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:31 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1738 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:46:32.594406 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-82250908-b2c8-4b1e-ac25-56ff78e4f707 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:32.595287 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-82250908-b2c8-4b1e-ac25-56ff78e4f707 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:32.603212 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-82250908-b2c8-4b1e-ac25-56ff78e4f707 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:32.603875 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-82250908-b2c8-4b1e-ac25-56ff78e4f707 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:32.604884 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-82250908-b2c8-4b1e-ac25-56ff78e4f707 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:32.605677 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-82250908-b2c8-4b1e-ac25-56ff78e4f707 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:32.764166 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-82250908-b2c8-4b1e-ac25-56ff78e4f707 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:32.773512 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-82250908-b2c8-4b1e-ac25-56ff78e4f707 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:32.775549 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-82250908-b2c8-4b1e-ac25-56ff78e4f707 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:32.776799 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-82250908-b2c8-4b1e-ac25-56ff78e4f707 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1738 microversion: 2.20 time: 0.186990 Jun 23 22:46:32.777735 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 490/956] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:32 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:33.796513 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-ffb5ebec-2b34-490e-b9de-1eb34975bbb5 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:33.797873 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-ffb5ebec-2b34-490e-b9de-1eb34975bbb5 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:33.805735 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ffb5ebec-2b34-490e-b9de-1eb34975bbb5 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:33.806184 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ffb5ebec-2b34-490e-b9de-1eb34975bbb5 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:33.806992 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ffb5ebec-2b34-490e-b9de-1eb34975bbb5 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:33.807432 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ffb5ebec-2b34-490e-b9de-1eb34975bbb5 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:33.966576 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ffb5ebec-2b34-490e-b9de-1eb34975bbb5 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:33.976065 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ffb5ebec-2b34-490e-b9de-1eb34975bbb5 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:33.977854 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ffb5ebec-2b34-490e-b9de-1eb34975bbb5 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:33.979511 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-ffb5ebec-2b34-490e-b9de-1eb34975bbb5 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1738 microversion: 2.20 time: 0.187376 Jun 23 22:46:33.980234 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 467/957] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:33 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1738 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:35.000370 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-ea58b451-db63-4c4f-812d-39892f4e9031 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:35.001156 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-ea58b451-db63-4c4f-812d-39892f4e9031 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:35.008711 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ea58b451-db63-4c4f-812d-39892f4e9031 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:35.009285 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ea58b451-db63-4c4f-812d-39892f4e9031 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:35.010302 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ea58b451-db63-4c4f-812d-39892f4e9031 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:35.011446 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ea58b451-db63-4c4f-812d-39892f4e9031 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:35.160853 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-ea58b451-db63-4c4f-812d-39892f4e9031 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:35.172881 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-ea58b451-db63-4c4f-812d-39892f4e9031 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:35.174554 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-ea58b451-db63-4c4f-812d-39892f4e9031 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:35.176535 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-ea58b451-db63-4c4f-812d-39892f4e9031 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1738 microversion: 2.20 time: 0.179332 Jun 23 22:46:35.177351 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 491/958] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:34 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:36.197461 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-3605be45-8b29-46f5-80ad-c75f5d8e1dcb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:36.199473 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-3605be45-8b29-46f5-80ad-c75f5d8e1dcb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:36.208265 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3605be45-8b29-46f5-80ad-c75f5d8e1dcb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:36.209245 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3605be45-8b29-46f5-80ad-c75f5d8e1dcb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:36.210292 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3605be45-8b29-46f5-80ad-c75f5d8e1dcb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:36.211173 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3605be45-8b29-46f5-80ad-c75f5d8e1dcb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:36.420801 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-3605be45-8b29-46f5-80ad-c75f5d8e1dcb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:36.430504 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-3605be45-8b29-46f5-80ad-c75f5d8e1dcb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:36.433001 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-3605be45-8b29-46f5-80ad-c75f5d8e1dcb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:36.434455 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-3605be45-8b29-46f5-80ad-c75f5d8e1dcb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1738 microversion: 2.20 time: 0.243052 Jun 23 22:46:36.435627 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 468/959] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:36 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1738 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:36.941975 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-377f91cb-a3a6-4c7f-b6eb-2dc093996fa8 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:36.942506 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-377f91cb-a3a6-4c7f-b6eb-2dc093996fa8 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 60c4a691-2c7d-4621-bfad-17e7a30b5724] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:36.955804 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-377f91cb-a3a6-4c7f-b6eb-2dc093996fa8 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:36.956329 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-377f91cb-a3a6-4c7f-b6eb-2dc093996fa8 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:36.959233 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-377f91cb-a3a6-4c7f-b6eb-2dc093996fa8 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:36.959753 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-377f91cb-a3a6-4c7f-b6eb-2dc093996fa8 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:36.997482 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-377f91cb-a3a6-4c7f-b6eb-2dc093996fa8 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 60c4a691-2c7d-4621-bfad-17e7a30b5724] Going to try to terminate instance {{(pid=124357) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:46:37.154077 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-262083a4-eb7b-4f62-a4a9-26b0e4ec0628 req-44814ece-d4de-4bd4-8c2b-1656670843c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60c4a691-2c7d-4621-bfad-17e7a30b5724", "tag": "28262990-c9a0-4ed8-bafe-2a4ebcc543dd"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:46:37.192499 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-262083a4-eb7b-4f62-a4a9-26b0e4ec0628 req-44814ece-d4de-4bd4-8c2b-1656670843c3 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:37.193247 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-377f91cb-a3a6-4c7f-b6eb-2dc093996fa8 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "DELETE /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724" status: 204 len: 0 microversion: 2.1 time: 0.255213 Jun 23 22:46:37.193806 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-262083a4-eb7b-4f62-a4a9-26b0e4ec0628 req-44814ece-d4de-4bd4-8c2b-1656670843c3 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:37.194339 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 492/960] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 23 22:46:36 2022] DELETE /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 22:46:37.219309 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-9a388ed3-8be0-4b04-ab84-71b6633ea8e6 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:37.220567 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-9a388ed3-8be0-4b04-ab84-71b6633ea8e6 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 60c4a691-2c7d-4621-bfad-17e7a30b5724] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:37.221845 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-262083a4-eb7b-4f62-a4a9-26b0e4ec0628 req-44814ece-d4de-4bd4-8c2b-1656670843c3 service nova] Creating event network-changed:28262990-c9a0-4ed8-bafe-2a4ebcc543dd for instance 60c4a691-2c7d-4621-bfad-17e7a30b5724 on hv-cinder-84617 Jun 23 22:46:37.235452 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9a388ed3-8be0-4b04-ab84-71b6633ea8e6 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:37.235907 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9a388ed3-8be0-4b04-ab84-71b6633ea8e6 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:37.236683 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9a388ed3-8be0-4b04-ab84-71b6633ea8e6 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:37.237112 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9a388ed3-8be0-4b04-ab84-71b6633ea8e6 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:37.245395 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-262083a4-eb7b-4f62-a4a9-26b0e4ec0628 req-44814ece-d4de-4bd4-8c2b-1656670843c3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.299685 Jun 23 22:46:37.245912 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 469/961] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:46:37.454898 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e7f8c255-d222-414c-a215-744ef083b35c tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:37.456061 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e7f8c255-d222-414c-a215-744ef083b35c tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:37.467176 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e7f8c255-d222-414c-a215-744ef083b35c tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:37.468001 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e7f8c255-d222-414c-a215-744ef083b35c tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:37.469146 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e7f8c255-d222-414c-a215-744ef083b35c tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:37.474970 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e7f8c255-d222-414c-a215-744ef083b35c tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:37.492282 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-9a388ed3-8be0-4b04-ab84-71b6633ea8e6 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:37.506152 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-9a388ed3-8be0-4b04-ab84-71b6633ea8e6 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724" status: 200 len: 1578 microversion: 2.1 time: 0.304893 Jun 23 22:46:37.506753 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 493/962] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:37 2022] GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724 => generated 1578 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:37.709232 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e7f8c255-d222-414c-a215-744ef083b35c tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:37.718100 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e7f8c255-d222-414c-a215-744ef083b35c tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:37.722278 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e7f8c255-d222-414c-a215-744ef083b35c tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:37.724635 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e7f8c255-d222-414c-a215-744ef083b35c tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1738 microversion: 2.20 time: 0.274602 Jun 23 22:46:37.738378 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 470/963] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:37 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1738 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:46:38.524875 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-167aeea6-e16b-4746-8e12-035dd2790e7d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:38.525482 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-167aeea6-e16b-4746-8e12-035dd2790e7d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 60c4a691-2c7d-4621-bfad-17e7a30b5724] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:38.532168 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-167aeea6-e16b-4746-8e12-035dd2790e7d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:38.533253 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-167aeea6-e16b-4746-8e12-035dd2790e7d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:38.534053 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-167aeea6-e16b-4746-8e12-035dd2790e7d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:38.534493 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-167aeea6-e16b-4746-8e12-035dd2790e7d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:38.672576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-167aeea6-e16b-4746-8e12-035dd2790e7d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:38.681070 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-167aeea6-e16b-4746-8e12-035dd2790e7d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724" status: 200 len: 1578 microversion: 2.1 time: 0.159990 Jun 23 22:46:38.681556 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 494/964] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:38 2022] GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724 => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:38.743750 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-6bc04800-8b33-4832-8672-cb4b76389b6a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:38.744802 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-6bc04800-8b33-4832-8672-cb4b76389b6a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:38.751673 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6bc04800-8b33-4832-8672-cb4b76389b6a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:38.752129 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6bc04800-8b33-4832-8672-cb4b76389b6a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:38.752875 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6bc04800-8b33-4832-8672-cb4b76389b6a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:38.753299 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6bc04800-8b33-4832-8672-cb4b76389b6a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:38.883890 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-6bc04800-8b33-4832-8672-cb4b76389b6a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:38.891735 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-6bc04800-8b33-4832-8672-cb4b76389b6a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:38.893335 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-6bc04800-8b33-4832-8672-cb4b76389b6a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:38.894577 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-6bc04800-8b33-4832-8672-cb4b76389b6a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1738 microversion: 2.20 time: 0.154795 Jun 23 22:46:38.895431 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 471/965] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:38 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:39.699104 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-5172103c-a6d2-4d03-bc32-06369504545f tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:39.699649 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-5172103c-a6d2-4d03-bc32-06369504545f tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 60c4a691-2c7d-4621-bfad-17e7a30b5724] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:39.706112 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5172103c-a6d2-4d03-bc32-06369504545f tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:39.706561 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5172103c-a6d2-4d03-bc32-06369504545f tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:39.707381 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5172103c-a6d2-4d03-bc32-06369504545f tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:39.707817 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5172103c-a6d2-4d03-bc32-06369504545f tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:39.710602 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:46:39.913648 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a1ab84db-121c-4231-9caf-cede04073bfe tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:39.915156 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-a1ab84db-121c-4231-9caf-cede04073bfe tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:39.921658 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a1ab84db-121c-4231-9caf-cede04073bfe tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:39.922094 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a1ab84db-121c-4231-9caf-cede04073bfe tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:39.922943 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a1ab84db-121c-4231-9caf-cede04073bfe tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:39.923581 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a1ab84db-121c-4231-9caf-cede04073bfe tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:40.177741 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-5172103c-a6d2-4d03-bc32-06369504545f tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:40.185596 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-5172103c-a6d2-4d03-bc32-06369504545f tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724" status: 200 len: 1578 microversion: 2.1 time: 0.490567 Jun 23 22:46:40.186298 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 495/966] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:39 2022] GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724 => generated 1578 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:40.377502 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-a1ab84db-121c-4231-9caf-cede04073bfe tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:40.379909 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:46:40.387592 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-a1ab84db-121c-4231-9caf-cede04073bfe tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:40.389193 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-a1ab84db-121c-4231-9caf-cede04073bfe tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:40.390423 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-a1ab84db-121c-4231-9caf-cede04073bfe tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1720 microversion: 2.20 time: 0.481678 Jun 23 22:46:40.391004 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 472/967] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:39 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1720 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:46:40.805512 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [req-e9d75ac1-9697-4c7d-b395-9b68356fb0f1 req-2536fc5d-f682-4eb6-983a-fc47919f559b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60c4a691-2c7d-4621-bfad-17e7a30b5724", "name": "network-vif-deleted", "tag": "28262990-c9a0-4ed8-bafe-2a4ebcc543dd"}]} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:46:40.814852 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-e9d75ac1-9697-4c7d-b395-9b68356fb0f1 req-2536fc5d-f682-4eb6-983a-fc47919f559b service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:40.815322 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-e9d75ac1-9697-4c7d-b395-9b68356fb0f1 req-2536fc5d-f682-4eb6-983a-fc47919f559b service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:40.827117 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.compute.server_external_events [req-e9d75ac1-9697-4c7d-b395-9b68356fb0f1 req-2536fc5d-f682-4eb6-983a-fc47919f559b service nova] Creating event network-vif-deleted:28262990-c9a0-4ed8-bafe-2a4ebcc543dd for instance 60c4a691-2c7d-4621-bfad-17e7a30b5724 on hv-cinder-84617 Jun 23 22:46:40.832336 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [req-e9d75ac1-9697-4c7d-b395-9b68356fb0f1 req-2536fc5d-f682-4eb6-983a-fc47919f559b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029977 Jun 23 22:46:40.832938 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 496/968] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:46:41.202765 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c03e0af9-c77c-44a8-aae5-2ec98835454a tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:41.203524 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c03e0af9-c77c-44a8-aae5-2ec98835454a tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 60c4a691-2c7d-4621-bfad-17e7a30b5724] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:41.211955 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c03e0af9-c77c-44a8-aae5-2ec98835454a tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:41.212399 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c03e0af9-c77c-44a8-aae5-2ec98835454a tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:41.213165 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c03e0af9-c77c-44a8-aae5-2ec98835454a tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:41.213648 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c03e0af9-c77c-44a8-aae5-2ec98835454a tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:41.281193 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c03e0af9-c77c-44a8-aae5-2ec98835454a tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:41.289838 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c03e0af9-c77c-44a8-aae5-2ec98835454a tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724" status: 200 len: 1225 microversion: 2.1 time: 0.091071 Jun 23 22:46:41.290394 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 473/969] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:41 2022] GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:41.410706 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-38f90a0f-bd2e-447c-b91f-8bf173ed5619 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:41.411353 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-38f90a0f-bd2e-447c-b91f-8bf173ed5619 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:41.417663 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-38f90a0f-bd2e-447c-b91f-8bf173ed5619 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:41.418105 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-38f90a0f-bd2e-447c-b91f-8bf173ed5619 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:41.419147 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-38f90a0f-bd2e-447c-b91f-8bf173ed5619 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:41.419576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-38f90a0f-bd2e-447c-b91f-8bf173ed5619 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:41.548726 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-38f90a0f-bd2e-447c-b91f-8bf173ed5619 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:41.557633 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-38f90a0f-bd2e-447c-b91f-8bf173ed5619 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:41.559202 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-38f90a0f-bd2e-447c-b91f-8bf173ed5619 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:41.560359 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-38f90a0f-bd2e-447c-b91f-8bf173ed5619 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1720 microversion: 2.20 time: 0.154346 Jun 23 22:46:41.560913 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 497/970] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:41 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:42.081967 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-ee5f52f9-6987-47fa-a3d5-467fc3b3fe05 req-cc3548c7-98e7-4602-9b62-47349ff40f6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe4cae6a-0365-477a-bbcb-100245e62715", "name": "network-vif-unplugged", "status": "completed", "tag": "ca42cad6-fa77-4fa7-b9e0-48ce41a63154"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:46:42.090812 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-ee5f52f9-6987-47fa-a3d5-467fc3b3fe05 req-cc3548c7-98e7-4602-9b62-47349ff40f6e service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:42.091317 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-ee5f52f9-6987-47fa-a3d5-467fc3b3fe05 req-cc3548c7-98e7-4602-9b62-47349ff40f6e service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:42.106827 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-ee5f52f9-6987-47fa-a3d5-467fc3b3fe05 req-cc3548c7-98e7-4602-9b62-47349ff40f6e service nova] Creating event network-vif-unplugged:ca42cad6-fa77-4fa7-b9e0-48ce41a63154 for instance fe4cae6a-0365-477a-bbcb-100245e62715 on hv-cinder-84617 Jun 23 22:46:42.111797 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-ee5f52f9-6987-47fa-a3d5-467fc3b3fe05 req-cc3548c7-98e7-4602-9b62-47349ff40f6e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033730 Jun 23 22:46:42.112592 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 474/971] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:46:42.307667 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-bf76481c-1e2b-478f-8bbd-3e26e3ff3847 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:42.308444 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-bf76481c-1e2b-478f-8bbd-3e26e3ff3847 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 60c4a691-2c7d-4621-bfad-17e7a30b5724] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:42.315765 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-bf76481c-1e2b-478f-8bbd-3e26e3ff3847 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:42.317349 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-bf76481c-1e2b-478f-8bbd-3e26e3ff3847 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:42.318122 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-bf76481c-1e2b-478f-8bbd-3e26e3ff3847 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:42.318557 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-bf76481c-1e2b-478f-8bbd-3e26e3ff3847 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:42.383213 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-bf76481c-1e2b-478f-8bbd-3e26e3ff3847 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:42.390785 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-bf76481c-1e2b-478f-8bbd-3e26e3ff3847 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724" status: 200 len: 1225 microversion: 2.1 time: 0.087763 Jun 23 22:46:42.391373 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 498/972] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:42 2022] GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:46:42.579060 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-419e54d8-ba89-464d-b2f5-eee56b3b7679 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:42.579749 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-419e54d8-ba89-464d-b2f5-eee56b3b7679 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:42.587425 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-419e54d8-ba89-464d-b2f5-eee56b3b7679 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:42.587864 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-419e54d8-ba89-464d-b2f5-eee56b3b7679 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:42.588618 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-419e54d8-ba89-464d-b2f5-eee56b3b7679 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:42.589228 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-419e54d8-ba89-464d-b2f5-eee56b3b7679 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:42.725011 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-419e54d8-ba89-464d-b2f5-eee56b3b7679 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:42.736446 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-419e54d8-ba89-464d-b2f5-eee56b3b7679 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:42.738010 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-419e54d8-ba89-464d-b2f5-eee56b3b7679 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:42.739399 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-419e54d8-ba89-464d-b2f5-eee56b3b7679 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1720 microversion: 2.20 time: 0.164636 Jun 23 22:46:42.739960 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 475/973] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:42 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:43.408530 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-62d56b46-7f61-4a91-96bb-fe218500ec8b tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:43.409074 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-62d56b46-7f61-4a91-96bb-fe218500ec8b tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 60c4a691-2c7d-4621-bfad-17e7a30b5724] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:43.416803 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-62d56b46-7f61-4a91-96bb-fe218500ec8b tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:43.417405 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-62d56b46-7f61-4a91-96bb-fe218500ec8b tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:43.418069 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-62d56b46-7f61-4a91-96bb-fe218500ec8b tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:43.418877 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-62d56b46-7f61-4a91-96bb-fe218500ec8b tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:43.458917 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-62d56b46-7f61-4a91-96bb-fe218500ec8b tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:43.459354 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-62d56b46-7f61-4a91-96bb-fe218500ec8b tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:43.459822 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.objects.instance [None req-62d56b46-7f61-4a91-96bb-fe218500ec8b tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lazy-loading 'fault' on Instance uuid 60c4a691-2c7d-4621-bfad-17e7a30b5724 {{(pid=124357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:46:43.510592 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-62d56b46-7f61-4a91-96bb-fe218500ec8b tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:43.518304 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-62d56b46-7f61-4a91-96bb-fe218500ec8b tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724" status: 200 len: 1230 microversion: 2.1 time: 0.114241 Jun 23 22:46:43.519626 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 499/974] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:43 2022] GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724 => generated 1230 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:46:43.758527 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f2925721-fe2f-4b5f-b6e4-a4457d380da8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:43.759159 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-f2925721-fe2f-4b5f-b6e4-a4457d380da8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:43.765940 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f2925721-fe2f-4b5f-b6e4-a4457d380da8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:43.766373 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f2925721-fe2f-4b5f-b6e4-a4457d380da8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:43.767162 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f2925721-fe2f-4b5f-b6e4-a4457d380da8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:43.767588 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f2925721-fe2f-4b5f-b6e4-a4457d380da8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:43.897079 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f2925721-fe2f-4b5f-b6e4-a4457d380da8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:43.904946 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f2925721-fe2f-4b5f-b6e4-a4457d380da8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:43.906472 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-f2925721-fe2f-4b5f-b6e4-a4457d380da8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:43.907653 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f2925721-fe2f-4b5f-b6e4-a4457d380da8 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1663 microversion: 2.20 time: 0.153185 Jun 23 22:46:43.908206 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 476/975] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:43 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1663 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:43.925670 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-898c0a13-1a93-4984-993a-9abac8344a93 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55791d08-4f2e-43d5-9131-6929f12f0b1c"}} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:46:43.926717 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-898c0a13-1a93-4984-993a-9abac8344a93 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:43.932631 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-898c0a13-1a93-4984-993a-9abac8344a93 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:43.933074 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-898c0a13-1a93-4984-993a-9abac8344a93 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:43.933825 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-898c0a13-1a93-4984-993a-9abac8344a93 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:43.934257 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-898c0a13-1a93-4984-993a-9abac8344a93 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:44.197739 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-898c0a13-1a93-4984-993a-9abac8344a93 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "POST /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.275984 Jun 23 22:46:44.198337 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 500/976] 10.222.0.43 () {62 vars in 1363 bytes} [Thu Jun 23 22:46:43 2022] POST /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715/os-volume_attachments => generated 188 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 22:46:44.315790 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-30a1459e-c398-47d3-8acc-eedf81d2a119 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:44.316733 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-30a1459e-c398-47d3-8acc-eedf81d2a119 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:44.322870 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-30a1459e-c398-47d3-8acc-eedf81d2a119 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:44.323358 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-30a1459e-c398-47d3-8acc-eedf81d2a119 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:44.324134 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-30a1459e-c398-47d3-8acc-eedf81d2a119 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:44.324590 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-30a1459e-c398-47d3-8acc-eedf81d2a119 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:44.537546 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-9d229727-7de3-488d-9a0c-5b72e731c700 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:44.538076 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-9d229727-7de3-488d-9a0c-5b72e731c700 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 60c4a691-2c7d-4621-bfad-17e7a30b5724] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:44.544896 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9d229727-7de3-488d-9a0c-5b72e731c700 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:44.545345 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9d229727-7de3-488d-9a0c-5b72e731c700 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:44.546106 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9d229727-7de3-488d-9a0c-5b72e731c700 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:44.546532 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9d229727-7de3-488d-9a0c-5b72e731c700 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:44.563276 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.wsgi [None req-9d229727-7de3-488d-9a0c-5b72e731c700 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] HTTP exception thrown: Instance 60c4a691-2c7d-4621-bfad-17e7a30b5724 could not be found. Jun 23 22:46:44.564944 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-9d229727-7de3-488d-9a0c-5b72e731c700 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Request method failure captured: Jun 23 22:46:44.564944 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: request: GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724 HTTP/1.1 Jun 23 22:46:44.564944 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept: application/json Jun 23 22:46:44.564944 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept-Encoding: identity Jun 23 22:46:44.564944 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Connection: close Jun 23 22:46:44.564944 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Length: 0 Jun 23 22:46:44.564944 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Type: application/json Jun 23 22:46:44.564944 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Host: 10.222.0.43 Jun 23 22:46:44.564944 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Openstack-System-Scope: None Jun 23 22:46:44.564944 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: User-Agent: python-urllib3/1.26.9 Jun 23 22:46:44.564944 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Auth-Token: gAAAAABitOtjK-HI-EazU9u8w27rOjb4jM7eTXV67Bd6K7P0dzm98kyrdkjM0-jNhq89rpjjonjyRcrsCo5A7kac4Zva6tbEGhVRgOLyRjAF7_VOe1y4KF3FEl3LlFyHRRNXCu6dcVP9ay6Ryc7KhV0KLDkq9yUOyPB3ekv38VWERYsVPIua0RE Jun 23 22:46:44.564944 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Id: None Jun 23 22:46:44.564944 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Name: None Jun 23 22:46:44.564944 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Identity-Status: Confirmed Jun 23 22:46:44.564944 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Is-Admin-Project: True Jun 23 22:46:44.564944 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Id: default Jun 23 22:46:44.564944 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Name: Default Jun 23 22:46:44.564944 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Id: 1eb4b659032e4ec09a16c45b29d609f0 Jun 23 22:46:44.564944 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Name: tempest-TestVolumeBootPattern-1137358917 Jun 23 22:46:44.564944 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Role: reader,member Jun 23 22:46:44.564944 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Roles: reader,member Jun 23 22:46:44.567013 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1eb4b659032e4ec09a16c45b29d609f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1eb4b659032e4ec09a16c45b29d609f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1eb4b659032e4ec09a16c45b29d609f0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1eb4b659032e4ec09a16c45b29d609f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:46:44.567013 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant: tempest-TestVolumeBootPattern-1137358917 Jun 23 22:46:44.567013 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Id: 1eb4b659032e4ec09a16c45b29d609f0 Jun 23 22:46:44.567013 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Name: tempest-TestVolumeBootPattern-1137358917 Jun 23 22:46:44.567013 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User: tempest-TestVolumeBootPattern-1137358917-project Jun 23 22:46:44.567013 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Id: default Jun 23 22:46:44.567013 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Name: Default Jun 23 22:46:44.567013 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Id: f523b529906f4fa989d0e836d6a08944 Jun 23 22:46:44.567013 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Name: tempest-TestVolumeBootPattern-1137358917-project Jun 23 22:46:44.567013 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: method: > Jun 23 22:46:44.567013 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: exception: Instance 60c4a691-2c7d-4621-bfad-17e7a30b5724 could not be found. Jun 23 22:46:44.567013 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: action_args: {'id': '60c4a691-2c7d-4621-bfad-17e7a30b5724'} Jun 23 22:46:44.568054 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:46:44.568054 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:46:44.568054 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:46:44.568054 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:46:44.568054 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:46:44.568054 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:46:44.568054 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:46:44.568054 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:46:44.568054 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:46:44.568054 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:46:44.568054 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60c4a691-2c7d-4621-bfad-17e7a30b5724 could not be found. Jun 23 22:46:44.568054 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:46:44.568054 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:46:44.568054 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:46:44.568054 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:46:44.568054 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:46:44.568054 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:46:44.568054 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:46:44.568054 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:46:44.568054 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:46:44.569761 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:46:44.569761 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:46:44.569761 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:46:44.569761 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:46:44.569761 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:46:44.569761 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:46:44.569761 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:46:44.569761 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60c4a691-2c7d-4621-bfad-17e7a30b5724 could not be found. Jun 23 22:46:44.569761 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:46:44.569761 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:46:44.569761 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:46:44.569761 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:46:44.569761 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:46:44.569761 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:46:44.569761 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:46:44.569761 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:46:44.569761 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60c4a691-2c7d-4621-bfad-17e7a30b5724 could not be found. Jun 23 22:46:44.569761 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:46:44.571448 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-9d229727-7de3-488d-9a0c-5b72e731c700 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Returning 404 to user: Instance 60c4a691-2c7d-4621-bfad-17e7a30b5724 could not be found. {{(pid=124357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:46:44.571448 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-9d229727-7de3-488d-9a0c-5b72e731c700 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724" status: 404 len: 111 microversion: 2.1 time: 0.035518 Jun 23 22:46:44.571448 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 501/977] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:44 2022] GET /compute/v2.1/servers/60c4a691-2c7d-4621-bfad-17e7a30b5724 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 22:46:44.583484 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-30a1459e-c398-47d3-8acc-eedf81d2a119 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715/os-volume_attachments/55791d08-4f2e-43d5-9131-6929f12f0b1c" status: 202 len: 0 microversion: 2.20 time: 0.271466 Jun 23 22:46:44.584170 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 477/978] 10.222.0.43 () {60 vars in 1456 bytes} [Thu Jun 23 22:46:44 2022] DELETE /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715/os-volume_attachments/55791d08-4f2e-43d5-9131-6929f12f0b1c => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 23 22:46:44.642045 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-2f95ef44-fa44-40ff-be3d-9ec6d462501f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:46:44.642606 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-2f95ef44-fa44-40ff-be3d-9ec6d462501f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:44.650936 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2f95ef44-fa44-40ff-be3d-9ec6d462501f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:44.651488 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2f95ef44-fa44-40ff-be3d-9ec6d462501f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:44.652666 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2f95ef44-fa44-40ff-be3d-9ec6d462501f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:44.653130 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-2f95ef44-fa44-40ff-be3d-9ec6d462501f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:44.742605 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-2f95ef44-fa44-40ff-be3d-9ec6d462501f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "POST /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715/action" status: 202 len: 0 microversion: 2.20 time: 0.105488 Jun 23 22:46:44.743595 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 502/979] 10.222.0.43 () {62 vars in 1318 bytes} [Thu Jun 23 22:46:44 2022] POST /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 22:46:44.752156 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-8188bd10-0c62-48ba-804a-21c3720cd3cc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:44.752849 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-8188bd10-0c62-48ba-804a-21c3720cd3cc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:44.760096 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8188bd10-0c62-48ba-804a-21c3720cd3cc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:44.760658 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8188bd10-0c62-48ba-804a-21c3720cd3cc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:44.761475 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8188bd10-0c62-48ba-804a-21c3720cd3cc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:44.761964 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8188bd10-0c62-48ba-804a-21c3720cd3cc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:44.901933 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-8188bd10-0c62-48ba-804a-21c3720cd3cc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:44.910553 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-8188bd10-0c62-48ba-804a-21c3720cd3cc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:44.912093 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-8188bd10-0c62-48ba-804a-21c3720cd3cc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:44.913241 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-8188bd10-0c62-48ba-804a-21c3720cd3cc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1671 microversion: 2.20 time: 0.165112 Jun 23 22:46:44.913818 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 478/980] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:44 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1671 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:45.933184 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-0708f86f-2ffa-47f5-83b4-a98ff7df0c06 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:45.933814 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-0708f86f-2ffa-47f5-83b4-a98ff7df0c06 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:45.940248 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-0708f86f-2ffa-47f5-83b4-a98ff7df0c06 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:45.940689 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-0708f86f-2ffa-47f5-83b4-a98ff7df0c06 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:45.942248 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-0708f86f-2ffa-47f5-83b4-a98ff7df0c06 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:45.942680 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-0708f86f-2ffa-47f5-83b4-a98ff7df0c06 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:46.142936 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-0708f86f-2ffa-47f5-83b4-a98ff7df0c06 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:46.152310 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-0708f86f-2ffa-47f5-83b4-a98ff7df0c06 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:46.153903 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-0708f86f-2ffa-47f5-83b4-a98ff7df0c06 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:46.155102 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-0708f86f-2ffa-47f5-83b4-a98ff7df0c06 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1729 microversion: 2.20 time: 0.225945 Jun 23 22:46:46.155652 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 503/981] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:45 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1729 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:46:47.174667 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-ae0ba9bb-d90e-4845-8941-c2c4528a36be tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:47.176102 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-ae0ba9bb-d90e-4845-8941-c2c4528a36be tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:47.185035 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ae0ba9bb-d90e-4845-8941-c2c4528a36be tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:47.186059 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ae0ba9bb-d90e-4845-8941-c2c4528a36be tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:47.187245 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ae0ba9bb-d90e-4845-8941-c2c4528a36be tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:47.187878 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-ae0ba9bb-d90e-4845-8941-c2c4528a36be tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:47.372298 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ae0ba9bb-d90e-4845-8941-c2c4528a36be tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:47.386450 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ae0ba9bb-d90e-4845-8941-c2c4528a36be tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:47.386760 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-ae0ba9bb-d90e-4845-8941-c2c4528a36be tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:47.388474 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-ae0ba9bb-d90e-4845-8941-c2c4528a36be tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1729 microversion: 2.20 time: 0.218397 Jun 23 22:46:47.389563 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 479/982] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:47 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1729 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:48.407965 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-cc49af8d-b821-43ea-94f4-236de4c91fdd tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:48.411291 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-cc49af8d-b821-43ea-94f4-236de4c91fdd tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:48.420620 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:46:48.422223 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-cc49af8d-b821-43ea-94f4-236de4c91fdd tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:48.422713 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-cc49af8d-b821-43ea-94f4-236de4c91fdd tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:48.423556 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-cc49af8d-b821-43ea-94f4-236de4c91fdd tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:48.423989 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-cc49af8d-b821-43ea-94f4-236de4c91fdd tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:48.729377 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-cc49af8d-b821-43ea-94f4-236de4c91fdd tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:48.752456 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-cc49af8d-b821-43ea-94f4-236de4c91fdd tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:48.754473 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-cc49af8d-b821-43ea-94f4-236de4c91fdd tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:48.755754 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-cc49af8d-b821-43ea-94f4-236de4c91fdd tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1729 microversion: 2.20 time: 0.352207 Jun 23 22:46:48.756315 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 504/983] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:48 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1729 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:48.841520 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-8b3e0b4a-eaf2-4404-946e-d8b13299f647 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:48.842011 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-8b3e0b4a-eaf2-4404-946e-d8b13299f647 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 846b1b54-898a-4e88-8367-3ffa42bf0d14] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:48.844061 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [req-a3258de6-71a9-48f7-b809-897c8ae4daa5 req-8d79ce7a-077b-481b-a104-df8653767494 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "846b1b54-898a-4e88-8367-3ffa42bf0d14", "tag": "876447a5-4914-447d-9445-4888cf15aa9a"}]} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:46:48.844491 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:46:48.851512 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8b3e0b4a-eaf2-4404-946e-d8b13299f647 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:48.851985 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8b3e0b4a-eaf2-4404-946e-d8b13299f647 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:48.852781 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8b3e0b4a-eaf2-4404-946e-d8b13299f647 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:48.853221 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-8b3e0b4a-eaf2-4404-946e-d8b13299f647 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:48.855463 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-a3258de6-71a9-48f7-b809-897c8ae4daa5 req-8d79ce7a-077b-481b-a104-df8653767494 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:48.856143 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-a3258de6-71a9-48f7-b809-897c8ae4daa5 req-8d79ce7a-077b-481b-a104-df8653767494 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:48.888184 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.compute.server_external_events [req-a3258de6-71a9-48f7-b809-897c8ae4daa5 req-8d79ce7a-077b-481b-a104-df8653767494 service nova] Creating event network-changed:876447a5-4914-447d-9445-4888cf15aa9a for instance 846b1b54-898a-4e88-8367-3ffa42bf0d14 on hv-cinder-84617 Jun 23 22:46:48.911685 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [req-a3258de6-71a9-48f7-b809-897c8ae4daa5 req-8d79ce7a-077b-481b-a104-df8653767494 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069930 Jun 23 22:46:48.913843 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 505/984] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:46:48.927576 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-8b3e0b4a-eaf2-4404-946e-d8b13299f647 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 846b1b54-898a-4e88-8367-3ffa42bf0d14] Going to try to terminate instance {{(pid=124358) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:46:49.068663 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-8b3e0b4a-eaf2-4404-946e-d8b13299f647 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "DELETE /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14" status: 204 len: 0 microversion: 2.1 time: 0.230417 Jun 23 22:46:49.069564 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 480/985] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 23 22:46:48 2022] DELETE /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 22:46:49.079655 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-650d9089-f98a-47f1-880d-ccf9c605c3c1 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:49.080658 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-650d9089-f98a-47f1-880d-ccf9c605c3c1 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 846b1b54-898a-4e88-8367-3ffa42bf0d14] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:49.093170 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-650d9089-f98a-47f1-880d-ccf9c605c3c1 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:49.093998 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-650d9089-f98a-47f1-880d-ccf9c605c3c1 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:49.095175 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-650d9089-f98a-47f1-880d-ccf9c605c3c1 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:49.095802 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-650d9089-f98a-47f1-880d-ccf9c605c3c1 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:49.309372 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-650d9089-f98a-47f1-880d-ccf9c605c3c1 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:49.320018 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-650d9089-f98a-47f1-880d-ccf9c605c3c1 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14" status: 200 len: 1578 microversion: 2.1 time: 0.245484 Jun 23 22:46:49.321300 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 506/986] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:49 2022] GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14 => generated 1578 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:46:49.774698 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-679a2b71-e9dd-41d3-ac5c-6204182a00ed tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:49.775416 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-679a2b71-e9dd-41d3-ac5c-6204182a00ed tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:49.788781 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-679a2b71-e9dd-41d3-ac5c-6204182a00ed tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:49.789332 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-679a2b71-e9dd-41d3-ac5c-6204182a00ed tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:49.790173 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-679a2b71-e9dd-41d3-ac5c-6204182a00ed tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:49.790603 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-679a2b71-e9dd-41d3-ac5c-6204182a00ed tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:50.311875 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-679a2b71-e9dd-41d3-ac5c-6204182a00ed tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:50.321918 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-679a2b71-e9dd-41d3-ac5c-6204182a00ed tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:50.323850 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-679a2b71-e9dd-41d3-ac5c-6204182a00ed tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:50.325365 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-679a2b71-e9dd-41d3-ac5c-6204182a00ed tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1729 microversion: 2.20 time: 0.555407 Jun 23 22:46:50.338521 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 481/987] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:49 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1729 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:50.343891 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-dc78d66e-00fd-4b80-9886-3661c459ab98 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:50.344595 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-dc78d66e-00fd-4b80-9886-3661c459ab98 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 846b1b54-898a-4e88-8367-3ffa42bf0d14] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:50.359995 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-dc78d66e-00fd-4b80-9886-3661c459ab98 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:50.360511 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-dc78d66e-00fd-4b80-9886-3661c459ab98 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:50.361468 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-dc78d66e-00fd-4b80-9886-3661c459ab98 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:50.361900 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-dc78d66e-00fd-4b80-9886-3661c459ab98 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:50.605752 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-dc78d66e-00fd-4b80-9886-3661c459ab98 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:50.625609 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-dc78d66e-00fd-4b80-9886-3661c459ab98 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14" status: 200 len: 1578 microversion: 2.1 time: 0.285803 Jun 23 22:46:50.633003 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 507/988] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:50 2022] GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14 => generated 1578 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:46:51.345269 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d463aa45-6c1e-4b4c-a74a-525e98d6d5c7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:51.345898 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-d463aa45-6c1e-4b4c-a74a-525e98d6d5c7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:51.353071 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d463aa45-6c1e-4b4c-a74a-525e98d6d5c7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:51.353508 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d463aa45-6c1e-4b4c-a74a-525e98d6d5c7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:51.354276 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d463aa45-6c1e-4b4c-a74a-525e98d6d5c7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:51.354908 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d463aa45-6c1e-4b4c-a74a-525e98d6d5c7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:51.651113 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-ac0874b1-100d-4d96-8335-22ac64de9ccd tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:51.651768 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-ac0874b1-100d-4d96-8335-22ac64de9ccd tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 846b1b54-898a-4e88-8367-3ffa42bf0d14] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:51.662133 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ac0874b1-100d-4d96-8335-22ac64de9ccd tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:51.662584 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ac0874b1-100d-4d96-8335-22ac64de9ccd tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:51.663475 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ac0874b1-100d-4d96-8335-22ac64de9ccd tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:51.664249 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ac0874b1-100d-4d96-8335-22ac64de9ccd tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:51.665634 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d463aa45-6c1e-4b4c-a74a-525e98d6d5c7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:51.675890 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d463aa45-6c1e-4b4c-a74a-525e98d6d5c7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:51.677851 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d463aa45-6c1e-4b4c-a74a-525e98d6d5c7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:51.679331 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d463aa45-6c1e-4b4c-a74a-525e98d6d5c7 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1729 microversion: 2.20 time: 0.337944 Jun 23 22:46:51.691802 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 482/989] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:51 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1729 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:46:52.092354 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-ac0874b1-100d-4d96-8335-22ac64de9ccd tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:52.101425 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-ac0874b1-100d-4d96-8335-22ac64de9ccd tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14" status: 200 len: 1578 microversion: 2.1 time: 0.454717 Jun 23 22:46:52.112031 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 508/990] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:51 2022] GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14 => generated 1578 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:52.698038 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-d762cbab-330e-494f-87e1-75e5ca2d36e4 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:52.698635 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-d762cbab-330e-494f-87e1-75e5ca2d36e4 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:52.705330 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d762cbab-330e-494f-87e1-75e5ca2d36e4 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:52.705643 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d762cbab-330e-494f-87e1-75e5ca2d36e4 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:52.706689 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d762cbab-330e-494f-87e1-75e5ca2d36e4 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:52.707333 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-d762cbab-330e-494f-87e1-75e5ca2d36e4 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:53.083542 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d762cbab-330e-494f-87e1-75e5ca2d36e4 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:53.094190 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d762cbab-330e-494f-87e1-75e5ca2d36e4 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:53.100498 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-d762cbab-330e-494f-87e1-75e5ca2d36e4 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:53.104341 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-d762cbab-330e-494f-87e1-75e5ca2d36e4 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1729 microversion: 2.20 time: 0.410265 Jun 23 22:46:53.104919 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 483/991] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:52 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1729 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:53.119639 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-1ca289b7-e939-4b4a-b5e5-6b85c4993f94 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:53.121525 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-1ca289b7-e939-4b4a-b5e5-6b85c4993f94 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 846b1b54-898a-4e88-8367-3ffa42bf0d14] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:53.137750 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1ca289b7-e939-4b4a-b5e5-6b85c4993f94 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:53.138504 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1ca289b7-e939-4b4a-b5e5-6b85c4993f94 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:53.140758 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1ca289b7-e939-4b4a-b5e5-6b85c4993f94 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:53.142895 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1ca289b7-e939-4b4a-b5e5-6b85c4993f94 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:53.395774 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-1ca289b7-e939-4b4a-b5e5-6b85c4993f94 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:53.399761 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:46:53.436576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-1ca289b7-e939-4b4a-b5e5-6b85c4993f94 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14" status: 200 len: 1578 microversion: 2.1 time: 0.320926 Jun 23 22:46:53.439451 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 509/992] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:53 2022] GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14 => generated 1578 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:54.130032 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-df558aa1-8611-4d01-9e4e-e62c9f73e4cc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:54.130636 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-df558aa1-8611-4d01-9e4e-e62c9f73e4cc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:54.148928 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-df558aa1-8611-4d01-9e4e-e62c9f73e4cc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:54.149382 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-df558aa1-8611-4d01-9e4e-e62c9f73e4cc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:54.150178 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-df558aa1-8611-4d01-9e4e-e62c9f73e4cc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:54.169031 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-df558aa1-8611-4d01-9e4e-e62c9f73e4cc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:54.429717 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-df558aa1-8611-4d01-9e4e-e62c9f73e4cc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:54.438410 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-df558aa1-8611-4d01-9e4e-e62c9f73e4cc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:54.440054 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-df558aa1-8611-4d01-9e4e-e62c9f73e4cc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:54.444692 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-df558aa1-8611-4d01-9e4e-e62c9f73e4cc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1729 microversion: 2.20 time: 0.318969 Jun 23 22:46:54.445313 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 484/993] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:54 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1729 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:54.457050 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-4c3a53a2-1901-4e3f-9860-997513ee308e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:54.458904 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-4c3a53a2-1901-4e3f-9860-997513ee308e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 846b1b54-898a-4e88-8367-3ffa42bf0d14] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:54.474127 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-4c3a53a2-1901-4e3f-9860-997513ee308e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:54.474127 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-4c3a53a2-1901-4e3f-9860-997513ee308e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:54.474127 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-4c3a53a2-1901-4e3f-9860-997513ee308e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:54.475062 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-4c3a53a2-1901-4e3f-9860-997513ee308e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:54.664479 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-4c3a53a2-1901-4e3f-9860-997513ee308e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:54.673046 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-4c3a53a2-1901-4e3f-9860-997513ee308e tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14" status: 200 len: 1578 microversion: 2.1 time: 0.221788 Jun 23 22:46:54.673613 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 510/994] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:54 2022] GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14 => generated 1578 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:55.661468 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c222616b-b534-4ff0-90e2-3809f3b8f602 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:55.662101 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c222616b-b534-4ff0-90e2-3809f3b8f602 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:55.668364 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c222616b-b534-4ff0-90e2-3809f3b8f602 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:55.669092 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c222616b-b534-4ff0-90e2-3809f3b8f602 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:55.669866 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c222616b-b534-4ff0-90e2-3809f3b8f602 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:55.670299 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c222616b-b534-4ff0-90e2-3809f3b8f602 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:55.695102 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-5e71e992-ea37-4511-8871-ede833201f63 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:55.696648 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-5e71e992-ea37-4511-8871-ede833201f63 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 846b1b54-898a-4e88-8367-3ffa42bf0d14] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:55.704916 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5e71e992-ea37-4511-8871-ede833201f63 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:55.705453 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5e71e992-ea37-4511-8871-ede833201f63 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:55.706347 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5e71e992-ea37-4511-8871-ede833201f63 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:55.706852 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5e71e992-ea37-4511-8871-ede833201f63 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:55.916423 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c222616b-b534-4ff0-90e2-3809f3b8f602 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:55.922325 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:46:55.932075 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c222616b-b534-4ff0-90e2-3809f3b8f602 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:55.933591 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c222616b-b534-4ff0-90e2-3809f3b8f602 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:55.935013 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c222616b-b534-4ff0-90e2-3809f3b8f602 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1729 microversion: 2.20 time: 0.475194 Jun 23 22:46:55.946170 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-5e71e992-ea37-4511-8871-ede833201f63 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:55.947470 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 485/995] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:55 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1729 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:55.954053 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-5e71e992-ea37-4511-8871-ede833201f63 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14" status: 200 len: 1578 microversion: 2.1 time: 0.267995 Jun 23 22:46:55.954915 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 511/996] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:55 2022] GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14 => generated 1578 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:46:56.954534 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-c3333334-09b6-42aa-868d-5de5fd3ecddc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:56.955828 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-c3333334-09b6-42aa-868d-5de5fd3ecddc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:56.967434 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c3333334-09b6-42aa-868d-5de5fd3ecddc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:56.974907 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c3333334-09b6-42aa-868d-5de5fd3ecddc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:56.976260 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c3333334-09b6-42aa-868d-5de5fd3ecddc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:56.976801 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-c3333334-09b6-42aa-868d-5de5fd3ecddc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:56.983215 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-9cd24cc7-6f70-41ca-bfaf-ae746b6b0072 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:56.984437 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-9cd24cc7-6f70-41ca-bfaf-ae746b6b0072 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 846b1b54-898a-4e88-8367-3ffa42bf0d14] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:56.997353 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9cd24cc7-6f70-41ca-bfaf-ae746b6b0072 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:56.998152 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9cd24cc7-6f70-41ca-bfaf-ae746b6b0072 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:56.999260 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9cd24cc7-6f70-41ca-bfaf-ae746b6b0072 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:56.999886 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9cd24cc7-6f70-41ca-bfaf-ae746b6b0072 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:57.330009 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-9cd24cc7-6f70-41ca-bfaf-ae746b6b0072 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:57.344981 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-9cd24cc7-6f70-41ca-bfaf-ae746b6b0072 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14" status: 200 len: 1578 microversion: 2.1 time: 0.374265 Jun 23 22:46:57.346452 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 512/997] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:56 2022] GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14 => generated 1578 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:57.380550 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c3333334-09b6-42aa-868d-5de5fd3ecddc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:57.396922 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c3333334-09b6-42aa-868d-5de5fd3ecddc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:57.398538 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-c3333334-09b6-42aa-868d-5de5fd3ecddc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:57.399764 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-c3333334-09b6-42aa-868d-5de5fd3ecddc tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1729 microversion: 2.20 time: 0.450082 Jun 23 22:46:57.402749 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 486/998] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:56 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1729 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:58.090626 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [req-5850ac14-f5ec-4cfc-81da-a8605127f261 req-80ad0f4e-ad0f-4879-9fdf-f8138337685a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "846b1b54-898a-4e88-8367-3ffa42bf0d14", "name": "network-vif-deleted", "tag": "876447a5-4914-447d-9445-4888cf15aa9a"}]} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:46:58.110046 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-5850ac14-f5ec-4cfc-81da-a8605127f261 req-80ad0f4e-ad0f-4879-9fdf-f8138337685a service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:58.114059 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-5850ac14-f5ec-4cfc-81da-a8605127f261 req-80ad0f4e-ad0f-4879-9fdf-f8138337685a service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:58.157870 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.compute.server_external_events [req-5850ac14-f5ec-4cfc-81da-a8605127f261 req-80ad0f4e-ad0f-4879-9fdf-f8138337685a service nova] Creating event network-vif-deleted:876447a5-4914-447d-9445-4888cf15aa9a for instance 846b1b54-898a-4e88-8367-3ffa42bf0d14 on hv-cinder-84617 Jun 23 22:46:58.164835 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [req-5850ac14-f5ec-4cfc-81da-a8605127f261 req-80ad0f4e-ad0f-4879-9fdf-f8138337685a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081281 Jun 23 22:46:58.182787 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 513/999] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:46:58.366243 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-7272be07-e92c-41b7-a10e-c83fef55d3e1 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:58.368376 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-7272be07-e92c-41b7-a10e-c83fef55d3e1 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 846b1b54-898a-4e88-8367-3ffa42bf0d14] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:58.382766 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7272be07-e92c-41b7-a10e-c83fef55d3e1 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:58.384239 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7272be07-e92c-41b7-a10e-c83fef55d3e1 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:58.385480 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7272be07-e92c-41b7-a10e-c83fef55d3e1 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:58.386110 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7272be07-e92c-41b7-a10e-c83fef55d3e1 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:58.422557 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-87eab5c8-275a-46ef-882a-6ea5da84c62d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:58.423875 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-87eab5c8-275a-46ef-882a-6ea5da84c62d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:58.437353 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-87eab5c8-275a-46ef-882a-6ea5da84c62d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:58.440238 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-87eab5c8-275a-46ef-882a-6ea5da84c62d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:58.446511 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-87eab5c8-275a-46ef-882a-6ea5da84c62d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:58.446993 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-87eab5c8-275a-46ef-882a-6ea5da84c62d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:58.499755 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-7272be07-e92c-41b7-a10e-c83fef55d3e1 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f523b529906f4fa989d0e836d6a08944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb4b659032e4ec09a16c45b29d609f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:58.524502 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-7272be07-e92c-41b7-a10e-c83fef55d3e1 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14" status: 200 len: 1225 microversion: 2.1 time: 0.164863 Jun 23 22:46:58.525642 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 487/1000] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:58 2022] GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14 => generated 1225 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:58.737313 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-87eab5c8-275a-46ef-882a-6ea5da84c62d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:58.748243 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-87eab5c8-275a-46ef-882a-6ea5da84c62d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:58.749789 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-87eab5c8-275a-46ef-882a-6ea5da84c62d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:58.751206 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-87eab5c8-275a-46ef-882a-6ea5da84c62d tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1729 microversion: 2.20 time: 0.333457 Jun 23 22:46:58.775945 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 514/1001] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:58 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1729 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:59.550235 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e819c7b3-2a12-42b3-b506-8d0d120d5e0f tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:59.551804 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e819c7b3-2a12-42b3-b506-8d0d120d5e0f tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: 846b1b54-898a-4e88-8367-3ffa42bf0d14] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:59.565417 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e819c7b3-2a12-42b3-b506-8d0d120d5e0f tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:59.566569 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e819c7b3-2a12-42b3-b506-8d0d120d5e0f tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:59.572648 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e819c7b3-2a12-42b3-b506-8d0d120d5e0f tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:59.573365 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e819c7b3-2a12-42b3-b506-8d0d120d5e0f tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:59.606903 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-e819c7b3-2a12-42b3-b506-8d0d120d5e0f tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] HTTP exception thrown: Instance 846b1b54-898a-4e88-8367-3ffa42bf0d14 could not be found. Jun 23 22:46:59.608928 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e819c7b3-2a12-42b3-b506-8d0d120d5e0f tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Request method failure captured: Jun 23 22:46:59.608928 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: request: GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14 HTTP/1.1 Jun 23 22:46:59.608928 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept: application/json Jun 23 22:46:59.608928 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Jun 23 22:46:59.608928 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Connection: close Jun 23 22:46:59.608928 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Length: 0 Jun 23 22:46:59.608928 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Type: application/json Jun 23 22:46:59.608928 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Host: 10.222.0.43 Jun 23 22:46:59.608928 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Jun 23 22:46:59.608928 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.9 Jun 23 22:46:59.608928 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABitOtjK-HI-EazU9u8w27rOjb4jM7eTXV67Bd6K7P0dzm98kyrdkjM0-jNhq89rpjjonjyRcrsCo5A7kac4Zva6tbEGhVRgOLyRjAF7_VOe1y4KF3FEl3LlFyHRRNXCu6dcVP9ay6Ryc7KhV0KLDkq9yUOyPB3ekv38VWERYsVPIua0RE Jun 23 22:46:59.608928 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Jun 23 22:46:59.608928 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Jun 23 22:46:59.608928 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Jun 23 22:46:59.608928 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Jun 23 22:46:59.608928 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Jun 23 22:46:59.608928 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Jun 23 22:46:59.608928 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Id: 1eb4b659032e4ec09a16c45b29d609f0 Jun 23 22:46:59.608928 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-TestVolumeBootPattern-1137358917 Jun 23 22:46:59.608928 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Role: reader,member Jun 23 22:46:59.608928 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Roles: reader,member Jun 23 22:46:59.610421 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1eb4b659032e4ec09a16c45b29d609f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1eb4b659032e4ec09a16c45b29d609f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1eb4b659032e4ec09a16c45b29d609f0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1eb4b659032e4ec09a16c45b29d609f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:46:59.610421 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-TestVolumeBootPattern-1137358917 Jun 23 22:46:59.610421 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Id: 1eb4b659032e4ec09a16c45b29d609f0 Jun 23 22:46:59.610421 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-TestVolumeBootPattern-1137358917 Jun 23 22:46:59.610421 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User: tempest-TestVolumeBootPattern-1137358917-project Jun 23 22:46:59.610421 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Jun 23 22:46:59.610421 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Jun 23 22:46:59.610421 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Id: f523b529906f4fa989d0e836d6a08944 Jun 23 22:46:59.610421 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-TestVolumeBootPattern-1137358917-project Jun 23 22:46:59.610421 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: method: > Jun 23 22:46:59.610421 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: exception: Instance 846b1b54-898a-4e88-8367-3ffa42bf0d14 could not be found. Jun 23 22:46:59.610421 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: action_args: {'id': '846b1b54-898a-4e88-8367-3ffa42bf0d14'} Jun 23 22:46:59.611334 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:46:59.611334 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:46:59.611334 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:46:59.611334 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:46:59.611334 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:46:59.611334 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:46:59.611334 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:46:59.611334 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:46:59.611334 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:46:59.611334 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:46:59.611334 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 846b1b54-898a-4e88-8367-3ffa42bf0d14 could not be found. Jun 23 22:46:59.611334 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:46:59.611334 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:46:59.611334 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:46:59.611334 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:46:59.611334 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:46:59.611334 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:46:59.611334 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:46:59.611334 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:46:59.611334 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:46:59.612853 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:46:59.612853 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:46:59.612853 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:46:59.612853 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:46:59.612853 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:46:59.612853 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:46:59.612853 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:46:59.612853 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 846b1b54-898a-4e88-8367-3ffa42bf0d14 could not be found. Jun 23 22:46:59.612853 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:46:59.612853 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:46:59.612853 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:46:59.612853 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:46:59.612853 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:46:59.612853 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:46:59.612853 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:46:59.612853 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:46:59.612853 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 846b1b54-898a-4e88-8367-3ffa42bf0d14 could not be found. Jun 23 22:46:59.612853 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:46:59.614064 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e819c7b3-2a12-42b3-b506-8d0d120d5e0f tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Returning 404 to user: Instance 846b1b54-898a-4e88-8367-3ffa42bf0d14 could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:46:59.622037 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e819c7b3-2a12-42b3-b506-8d0d120d5e0f tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14" status: 404 len: 111 microversion: 2.1 time: 0.065053 Jun 23 22:46:59.622882 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 488/1002] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:59 2022] GET /compute/v2.1/servers/846b1b54-898a-4e88-8367-3ffa42bf0d14 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:46:59.769965 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-eba0d2ad-6211-4d8a-9a51-e6a274b8de08 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:59.770597 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-eba0d2ad-6211-4d8a-9a51-e6a274b8de08 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:59.782751 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-eba0d2ad-6211-4d8a-9a51-e6a274b8de08 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:59.783245 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-eba0d2ad-6211-4d8a-9a51-e6a274b8de08 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:59.784633 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-eba0d2ad-6211-4d8a-9a51-e6a274b8de08 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:59.785260 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-eba0d2ad-6211-4d8a-9a51-e6a274b8de08 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:00.140328 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-eba0d2ad-6211-4d8a-9a51-e6a274b8de08 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:00.149980 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-eba0d2ad-6211-4d8a-9a51-e6a274b8de08 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:00.151604 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-eba0d2ad-6211-4d8a-9a51-e6a274b8de08 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:00.163544 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-eba0d2ad-6211-4d8a-9a51-e6a274b8de08 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1729 microversion: 2.20 time: 0.397583 Jun 23 22:47:00.164145 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 515/1003] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:59 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1729 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:47:00.370121 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-990a2837-b83a-4a98-a43b-11f8cb10d78d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:00.370897 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-990a2837-b83a-4a98-a43b-11f8cb10d78d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: b1da69bd-51f5-4223-b7aa-652d2636f36b] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:00.390605 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-990a2837-b83a-4a98-a43b-11f8cb10d78d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:00.391378 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-990a2837-b83a-4a98-a43b-11f8cb10d78d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:00.392394 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-990a2837-b83a-4a98-a43b-11f8cb10d78d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:00.392818 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-990a2837-b83a-4a98-a43b-11f8cb10d78d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:00.411031 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-990a2837-b83a-4a98-a43b-11f8cb10d78d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] HTTP exception thrown: Instance b1da69bd-51f5-4223-b7aa-652d2636f36b could not be found. Jun 23 22:47:00.412903 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-990a2837-b83a-4a98-a43b-11f8cb10d78d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Request method failure captured: Jun 23 22:47:00.412903 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: request: DELETE /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b HTTP/1.1 Jun 23 22:47:00.412903 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept: application/json Jun 23 22:47:00.412903 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Jun 23 22:47:00.412903 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Connection: close Jun 23 22:47:00.412903 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Length: 0 Jun 23 22:47:00.412903 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Type: application/json Jun 23 22:47:00.412903 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Host: 10.222.0.43 Jun 23 22:47:00.412903 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Jun 23 22:47:00.412903 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.9 Jun 23 22:47:00.412903 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABitOtjK-HI-EazU9u8w27rOjb4jM7eTXV67Bd6K7P0dzm98kyrdkjM0-jNhq89rpjjonjyRcrsCo5A7kac4Zva6tbEGhVRgOLyRjAF7_VOe1y4KF3FEl3LlFyHRRNXCu6dcVP9ay6Ryc7KhV0KLDkq9yUOyPB3ekv38VWERYsVPIua0RE Jun 23 22:47:00.412903 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Jun 23 22:47:00.412903 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Jun 23 22:47:00.412903 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Jun 23 22:47:00.412903 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Jun 23 22:47:00.412903 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Jun 23 22:47:00.412903 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Jun 23 22:47:00.412903 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Id: 1eb4b659032e4ec09a16c45b29d609f0 Jun 23 22:47:00.412903 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-TestVolumeBootPattern-1137358917 Jun 23 22:47:00.412903 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Role: reader,member Jun 23 22:47:00.412903 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Roles: reader,member Jun 23 22:47:00.414484 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1eb4b659032e4ec09a16c45b29d609f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1eb4b659032e4ec09a16c45b29d609f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1eb4b659032e4ec09a16c45b29d609f0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1eb4b659032e4ec09a16c45b29d609f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:47:00.414484 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-TestVolumeBootPattern-1137358917 Jun 23 22:47:00.414484 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Id: 1eb4b659032e4ec09a16c45b29d609f0 Jun 23 22:47:00.414484 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-TestVolumeBootPattern-1137358917 Jun 23 22:47:00.414484 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User: tempest-TestVolumeBootPattern-1137358917-project Jun 23 22:47:00.414484 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Jun 23 22:47:00.414484 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Jun 23 22:47:00.414484 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Id: f523b529906f4fa989d0e836d6a08944 Jun 23 22:47:00.414484 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-TestVolumeBootPattern-1137358917-project Jun 23 22:47:00.414484 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: method: > Jun 23 22:47:00.414484 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: exception: Instance b1da69bd-51f5-4223-b7aa-652d2636f36b could not be found. Jun 23 22:47:00.414484 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: action_args: {'id': 'b1da69bd-51f5-4223-b7aa-652d2636f36b'} Jun 23 22:47:00.415521 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:47:00.415521 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:47:00.415521 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:47:00.415521 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:47:00.415521 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:47:00.415521 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:47:00.415521 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:47:00.415521 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:47:00.415521 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:47:00.415521 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:47:00.415521 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1da69bd-51f5-4223-b7aa-652d2636f36b could not be found. Jun 23 22:47:00.415521 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:47:00.415521 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:47:00.415521 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:47:00.415521 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:47:00.415521 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:47:00.415521 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:47:00.415521 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:47:00.415521 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:47:00.415521 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:47:00.417050 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:47:00.417050 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 22:47:00.417050 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 22:47:00.417050 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 22:47:00.417050 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 22:47:00.417050 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:47:00.417050 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:47:00.417050 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:47:00.417050 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:47:00.417050 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1da69bd-51f5-4223-b7aa-652d2636f36b could not be found. Jun 23 22:47:00.417050 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:47:00.417050 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:47:00.417050 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:47:00.417050 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:47:00.417050 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:47:00.417050 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:47:00.417050 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:47:00.417050 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:47:00.417050 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1da69bd-51f5-4223-b7aa-652d2636f36b could not be found. Jun 23 22:47:00.417050 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:47:00.421111 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-990a2837-b83a-4a98-a43b-11f8cb10d78d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Returning 404 to user: Instance b1da69bd-51f5-4223-b7aa-652d2636f36b could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:47:00.422810 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-990a2837-b83a-4a98-a43b-11f8cb10d78d tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b" status: 404 len: 111 microversion: 2.1 time: 0.056775 Jun 23 22:47:00.430070 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 489/1004] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 23 22:47:00 2022] DELETE /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:47:00.435705 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-0a6c945f-c5e6-447b-9d45-24caafecbced tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:00.436580 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-0a6c945f-c5e6-447b-9d45-24caafecbced tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] [instance: b1da69bd-51f5-4223-b7aa-652d2636f36b] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:00.445918 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-0a6c945f-c5e6-447b-9d45-24caafecbced tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:00.446643 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-0a6c945f-c5e6-447b-9d45-24caafecbced tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:00.450534 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-0a6c945f-c5e6-447b-9d45-24caafecbced tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:00.451538 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-0a6c945f-c5e6-447b-9d45-24caafecbced tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:00.467575 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.wsgi [None req-0a6c945f-c5e6-447b-9d45-24caafecbced tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] HTTP exception thrown: Instance b1da69bd-51f5-4223-b7aa-652d2636f36b could not be found. Jun 23 22:47:00.469418 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-0a6c945f-c5e6-447b-9d45-24caafecbced tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Request method failure captured: Jun 23 22:47:00.469418 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: request: GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b HTTP/1.1 Jun 23 22:47:00.469418 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept: application/json Jun 23 22:47:00.469418 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept-Encoding: identity Jun 23 22:47:00.469418 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Connection: close Jun 23 22:47:00.469418 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Length: 0 Jun 23 22:47:00.469418 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Type: application/json Jun 23 22:47:00.469418 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Host: 10.222.0.43 Jun 23 22:47:00.469418 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Openstack-System-Scope: None Jun 23 22:47:00.469418 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: User-Agent: python-urllib3/1.26.9 Jun 23 22:47:00.469418 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Auth-Token: gAAAAABitOtjK-HI-EazU9u8w27rOjb4jM7eTXV67Bd6K7P0dzm98kyrdkjM0-jNhq89rpjjonjyRcrsCo5A7kac4Zva6tbEGhVRgOLyRjAF7_VOe1y4KF3FEl3LlFyHRRNXCu6dcVP9ay6Ryc7KhV0KLDkq9yUOyPB3ekv38VWERYsVPIua0RE Jun 23 22:47:00.469418 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Id: None Jun 23 22:47:00.469418 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Name: None Jun 23 22:47:00.469418 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Identity-Status: Confirmed Jun 23 22:47:00.469418 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Is-Admin-Project: True Jun 23 22:47:00.469418 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Id: default Jun 23 22:47:00.469418 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Name: Default Jun 23 22:47:00.469418 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Id: 1eb4b659032e4ec09a16c45b29d609f0 Jun 23 22:47:00.469418 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Name: tempest-TestVolumeBootPattern-1137358917 Jun 23 22:47:00.469418 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Role: reader,member Jun 23 22:47:00.469418 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Roles: reader,member Jun 23 22:47:00.470885 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1eb4b659032e4ec09a16c45b29d609f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1eb4b659032e4ec09a16c45b29d609f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1eb4b659032e4ec09a16c45b29d609f0", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1eb4b659032e4ec09a16c45b29d609f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:47:00.470885 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant: tempest-TestVolumeBootPattern-1137358917 Jun 23 22:47:00.470885 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Id: 1eb4b659032e4ec09a16c45b29d609f0 Jun 23 22:47:00.470885 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Name: tempest-TestVolumeBootPattern-1137358917 Jun 23 22:47:00.470885 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User: tempest-TestVolumeBootPattern-1137358917-project Jun 23 22:47:00.470885 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Id: default Jun 23 22:47:00.470885 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Name: Default Jun 23 22:47:00.470885 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Id: f523b529906f4fa989d0e836d6a08944 Jun 23 22:47:00.470885 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Name: tempest-TestVolumeBootPattern-1137358917-project Jun 23 22:47:00.470885 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: method: > Jun 23 22:47:00.470885 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: exception: Instance b1da69bd-51f5-4223-b7aa-652d2636f36b could not be found. Jun 23 22:47:00.470885 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: action_args: {'id': 'b1da69bd-51f5-4223-b7aa-652d2636f36b'} Jun 23 22:47:00.475879 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:47:00.475879 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:47:00.475879 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:47:00.475879 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:47:00.475879 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:47:00.475879 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:47:00.475879 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:47:00.475879 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:47:00.475879 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:47:00.475879 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:47:00.475879 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1da69bd-51f5-4223-b7aa-652d2636f36b could not be found. Jun 23 22:47:00.475879 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:47:00.475879 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:47:00.475879 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:47:00.475879 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:47:00.475879 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:47:00.475879 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:47:00.475879 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:47:00.475879 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:47:00.475879 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:47:00.477867 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:47:00.477867 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:47:00.477867 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:47:00.477867 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:47:00.477867 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:47:00.477867 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:47:00.477867 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:47:00.477867 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1da69bd-51f5-4223-b7aa-652d2636f36b could not be found. Jun 23 22:47:00.477867 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:47:00.477867 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:47:00.477867 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:47:00.477867 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:47:00.477867 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:47:00.477867 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:47:00.477867 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:47:00.477867 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:47:00.477867 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1da69bd-51f5-4223-b7aa-652d2636f36b could not be found. Jun 23 22:47:00.477867 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:47:00.481642 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-0a6c945f-c5e6-447b-9d45-24caafecbced tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Returning 404 to user: Instance b1da69bd-51f5-4223-b7aa-652d2636f36b could not be found. {{(pid=124357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:47:00.481642 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-0a6c945f-c5e6-447b-9d45-24caafecbced tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b" status: 404 len: 111 microversion: 2.1 time: 0.040317 Jun 23 22:47:00.481642 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 516/1005] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:00 2022] GET /compute/v2.1/servers/b1da69bd-51f5-4223-b7aa-652d2636f36b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:47:01.150586 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-f6149949-938b-46dc-8b5c-3369b2668f8f req-72c11912-3b38-43a2-99a9-3abf21789519 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe4cae6a-0365-477a-bbcb-100245e62715", "name": "network-vif-plugged", "status": "completed", "tag": "ca42cad6-fa77-4fa7-b9e0-48ce41a63154"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:47:01.166662 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-f6149949-938b-46dc-8b5c-3369b2668f8f req-72c11912-3b38-43a2-99a9-3abf21789519 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:01.167677 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-f6149949-938b-46dc-8b5c-3369b2668f8f req-72c11912-3b38-43a2-99a9-3abf21789519 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:01.184369 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-f6149949-938b-46dc-8b5c-3369b2668f8f req-72c11912-3b38-43a2-99a9-3abf21789519 service nova] Creating event network-vif-plugged:ca42cad6-fa77-4fa7-b9e0-48ce41a63154 for instance fe4cae6a-0365-477a-bbcb-100245e62715 on hv-cinder-84617 Jun 23 22:47:01.193231 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-f6149949-938b-46dc-8b5c-3369b2668f8f req-72c11912-3b38-43a2-99a9-3abf21789519 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.381596 Jun 23 22:47:01.194386 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 490/1006] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:47:01.196984 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-c4477e6e-f6ee-4aa6-ab3f-4f10b9a8cb29 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:01.199326 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-c4477e6e-f6ee-4aa6-ab3f-4f10b9a8cb29 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:01.243120 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c4477e6e-f6ee-4aa6-ab3f-4f10b9a8cb29 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:01.243720 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c4477e6e-f6ee-4aa6-ab3f-4f10b9a8cb29 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:01.246537 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c4477e6e-f6ee-4aa6-ab3f-4f10b9a8cb29 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:01.247394 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c4477e6e-f6ee-4aa6-ab3f-4f10b9a8cb29 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:01.569892 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-c4477e6e-f6ee-4aa6-ab3f-4f10b9a8cb29 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:01.586624 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-c4477e6e-f6ee-4aa6-ab3f-4f10b9a8cb29 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:01.596915 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-c4477e6e-f6ee-4aa6-ab3f-4f10b9a8cb29 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:01.599396 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-c4477e6e-f6ee-4aa6-ab3f-4f10b9a8cb29 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1729 microversion: 2.20 time: 0.421015 Jun 23 22:47:01.600313 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 517/1007] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:47:01 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1729 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:47:01.863475 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-3c024983-04c8-48ec-9679-9df569f74949 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] Calling method '.version_select at 0x7fb719692280>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:01.890361 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-3c024983-04c8-48ec-9679-9df569f74949 tempest-TestVolumeBootPattern-1137358917 tempest-TestVolumeBootPattern-1137358917-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-932418013" status: 202 len: 0 microversion: 2.1 time: 0.032480 Jun 23 22:47:01.891314 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 491/1008] 10.222.0.43 () {58 vars in 1259 bytes} [Thu Jun 23 22:47:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-932418013 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:47:02.626189 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-ec76bc58-9ef7-42f6-8906-b4e968059d57 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:02.627475 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-ec76bc58-9ef7-42f6-8906-b4e968059d57 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:02.641290 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ec76bc58-9ef7-42f6-8906-b4e968059d57 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:02.644285 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ec76bc58-9ef7-42f6-8906-b4e968059d57 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:02.650603 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ec76bc58-9ef7-42f6-8906-b4e968059d57 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:02.651355 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-ec76bc58-9ef7-42f6-8906-b4e968059d57 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:02.995269 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-ec76bc58-9ef7-42f6-8906-b4e968059d57 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:03.039556 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-ec76bc58-9ef7-42f6-8906-b4e968059d57 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:03.041371 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-ec76bc58-9ef7-42f6-8906-b4e968059d57 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:03.042756 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-ec76bc58-9ef7-42f6-8906-b4e968059d57 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1729 microversion: 2.20 time: 0.428002 Jun 23 22:47:03.043960 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 518/1009] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:47:02 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1729 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:47:04.063222 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-48c3f930-05a4-4ae4-8c40-c274c84d4395 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:04.064616 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-48c3f930-05a4-4ae4-8c40-c274c84d4395 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:04.074911 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-48c3f930-05a4-4ae4-8c40-c274c84d4395 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:04.075667 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-48c3f930-05a4-4ae4-8c40-c274c84d4395 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:04.076617 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-48c3f930-05a4-4ae4-8c40-c274c84d4395 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:04.077207 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-48c3f930-05a4-4ae4-8c40-c274c84d4395 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:04.311059 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-48c3f930-05a4-4ae4-8c40-c274c84d4395 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:04.329004 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-48c3f930-05a4-4ae4-8c40-c274c84d4395 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:04.336501 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-48c3f930-05a4-4ae4-8c40-c274c84d4395 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:04.337960 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-48c3f930-05a4-4ae4-8c40-c274c84d4395 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1729 microversion: 2.20 time: 0.278814 Jun 23 22:47:04.338629 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 492/1010] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:47:04 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1729 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:47:05.359043 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-217082d2-fbff-42fb-af7b-98537c53fc89 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:05.359669 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-217082d2-fbff-42fb-af7b-98537c53fc89 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:05.375999 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-217082d2-fbff-42fb-af7b-98537c53fc89 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:05.376739 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-217082d2-fbff-42fb-af7b-98537c53fc89 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:05.377986 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-217082d2-fbff-42fb-af7b-98537c53fc89 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:05.378582 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-217082d2-fbff-42fb-af7b-98537c53fc89 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:05.699865 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-217082d2-fbff-42fb-af7b-98537c53fc89 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:05.710679 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-217082d2-fbff-42fb-af7b-98537c53fc89 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:05.717806 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-217082d2-fbff-42fb-af7b-98537c53fc89 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:05.719050 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-217082d2-fbff-42fb-af7b-98537c53fc89 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1716 microversion: 2.20 time: 0.363906 Jun 23 22:47:05.734166 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 519/1011] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:47:05 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1716 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:47:14.269149 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-3bddca7f-5299-48e7-9a53-cc41c50e536c tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Action: 'create', calling method: .version_select at 0x7fb719650550>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1726234061", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmTdVNboBDL6E790t8/sczw6QpKm6PDU8X+4SK6wbCVLuvAuNxc5JXV0B+ChvGAhbFpEcpGoRY8lia9vxYfy6VW6O5FrNDypwSz43SqxNv1NLsL79yf8BnqVkL9zA4TVA=="}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:47:14.273705 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:47:14.285560 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-3bddca7f-5299-48e7-9a53-cc41c50e536c tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Getting quotas for project cea45368b61d4748a164cc6b76293749. Resources: {'key_pairs'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:47:14.289798 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.quota [None req-3bddca7f-5299-48e7-9a53-cc41c50e536c tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Getting quotas for user 6867c020bf2a4db3b0a4cebb32c64aa3 and project cea45368b61d4748a164cc6b76293749. Resources: {'key_pairs'} {{(pid=124358) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:47:14.311670 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-3bddca7f-5299-48e7-9a53-cc41c50e536c tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.046451 Jun 23 22:47:14.312255 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 493/1012] 10.222.0.43 () {60 vars in 1158 bytes} [Thu Jun 23 22:47:14 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:47:14.408025 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-51bde992-1d61-4e46-a026-e68f622482ef tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1390844963", "imageRef": "c77e8a9d-638e-46e8-b345-7e8417d29e55", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1726234061", "networks": [{"uuid": "cd8c19e1-bc34-463d-b302-704d2f051ae3"}]}} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:47:14.461209 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.network.neutron [None req-51bde992-1d61-4e46-a026-e68f622482ef tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] validate_networks() for [('cd8c19e1-bc34-463d-b302-704d2f051ae3', None, None, None, None, None)] {{(pid=124357) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:47:14.927107 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-51bde992-1d61-4e46-a026-e68f622482ef tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Flavor limits 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:47:14.927534 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-51bde992-1d61-4e46-a026-e68f622482ef tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Image limits 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:47:14.928089 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-51bde992-1d61-4e46-a026-e68f622482ef tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Flavor pref 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:47:14.928500 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-51bde992-1d61-4e46-a026-e68f622482ef tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Image pref 0:0:0 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:47:14.928909 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.virt.hardware [None req-51bde992-1d61-4e46-a026-e68f622482ef tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124357) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:47:14.937608 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-51bde992-1d61-4e46-a026-e68f622482ef tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:14.938052 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-51bde992-1d61-4e46-a026-e68f622482ef tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:14.938844 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-51bde992-1d61-4e46-a026-e68f622482ef tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:14.939308 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-51bde992-1d61-4e46-a026-e68f622482ef tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:14.957198 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-51bde992-1d61-4e46-a026-e68f622482ef tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Getting quotas for project cea45368b61d4748a164cc6b76293749. Resources: {'instances', 'cores', 'ram'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:47:14.961151 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.quota [None req-51bde992-1d61-4e46-a026-e68f622482ef tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Getting quotas for user 6867c020bf2a4db3b0a4cebb32c64aa3 and project cea45368b61d4748a164cc6b76293749. Resources: {'instances', 'cores', 'ram'} {{(pid=124357) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:47:14.972386 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-51bde992-1d61-4e46-a026-e68f622482ef tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Going to run 1 instances... {{(pid=124357) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:47:14.974507 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-51bde992-1d61-4e46-a026-e68f622482ef tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c77e8a9d-638e-46e8-b345-7e8417d29e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124357) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:47:15.023186 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-51bde992-1d61-4e46-a026-e68f622482ef tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.618879 Jun 23 22:47:15.023835 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 520/1013] 10.222.0.43 () {60 vars in 1146 bytes} [Thu Jun 23 22:47:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 22:47:15.034879 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-4d1face8-efd4-4db4-8d43-3347b64efae5 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:15.036531 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-4d1face8-efd4-4db4-8d43-3347b64efae5 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:15.038728 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=24 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:47:15.097002 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4d1face8-efd4-4db4-8d43-3347b64efae5 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6867c020bf2a4db3b0a4cebb32c64aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea45368b61d4748a164cc6b76293749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:15.103015 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-4d1face8-efd4-4db4-8d43-3347b64efae5 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24" status: 200 len: 1259 microversion: 2.1 time: 0.072237 Jun 23 22:47:15.103917 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 494/1014] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:15 2022] GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24 => generated 1259 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:16.123009 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-eb37b0db-67ab-4ae5-9635-7727c92214bc tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:16.123009 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-eb37b0db-67ab-4ae5-9635-7727c92214bc tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:16.131960 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-eb37b0db-67ab-4ae5-9635-7727c92214bc tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:16.132408 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-eb37b0db-67ab-4ae5-9635-7727c92214bc tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:16.133209 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-eb37b0db-67ab-4ae5-9635-7727c92214bc tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:16.133817 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-eb37b0db-67ab-4ae5-9635-7727c92214bc tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:16.212226 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-eb37b0db-67ab-4ae5-9635-7727c92214bc tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6867c020bf2a4db3b0a4cebb32c64aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea45368b61d4748a164cc6b76293749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:16.220250 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-eb37b0db-67ab-4ae5-9635-7727c92214bc tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24" status: 200 len: 1317 microversion: 2.1 time: 0.102125 Jun 23 22:47:16.220354 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 521/1015] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:16 2022] GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24 => generated 1317 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:17.239253 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-4d9cf496-1fe5-45c0-81b2-a3e38eee9751 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:17.240652 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-4d9cf496-1fe5-45c0-81b2-a3e38eee9751 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:17.250157 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4d9cf496-1fe5-45c0-81b2-a3e38eee9751 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:17.250677 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4d9cf496-1fe5-45c0-81b2-a3e38eee9751 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:17.251630 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4d9cf496-1fe5-45c0-81b2-a3e38eee9751 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:17.252185 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-4d9cf496-1fe5-45c0-81b2-a3e38eee9751 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:17.414357 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-4d9cf496-1fe5-45c0-81b2-a3e38eee9751 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6867c020bf2a4db3b0a4cebb32c64aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea45368b61d4748a164cc6b76293749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:17.422050 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-4d9cf496-1fe5-45c0-81b2-a3e38eee9751 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24" status: 200 len: 1359 microversion: 2.1 time: 0.188536 Jun 23 22:47:17.422601 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 495/1016] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:17 2022] GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24 => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:18.441739 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-90c0ce60-91c3-4b9a-a856-0502ae30cd03 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:18.442277 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-90c0ce60-91c3-4b9a-a856-0502ae30cd03 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:18.449008 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-90c0ce60-91c3-4b9a-a856-0502ae30cd03 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:18.449464 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-90c0ce60-91c3-4b9a-a856-0502ae30cd03 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:18.450373 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-90c0ce60-91c3-4b9a-a856-0502ae30cd03 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:18.450817 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-90c0ce60-91c3-4b9a-a856-0502ae30cd03 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:18.603276 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-90c0ce60-91c3-4b9a-a856-0502ae30cd03 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6867c020bf2a4db3b0a4cebb32c64aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea45368b61d4748a164cc6b76293749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:18.611150 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-90c0ce60-91c3-4b9a-a856-0502ae30cd03 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24" status: 200 len: 1359 microversion: 2.1 time: 0.174067 Jun 23 22:47:18.611948 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 522/1017] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:18 2022] GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:19.628786 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-6a7308d8-865a-44d7-b08e-6775429cef43 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:19.629395 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-6a7308d8-865a-44d7-b08e-6775429cef43 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:19.635858 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6a7308d8-865a-44d7-b08e-6775429cef43 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:19.636306 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6a7308d8-865a-44d7-b08e-6775429cef43 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:19.637071 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6a7308d8-865a-44d7-b08e-6775429cef43 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:19.637508 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-6a7308d8-865a-44d7-b08e-6775429cef43 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:19.774514 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-6a7308d8-865a-44d7-b08e-6775429cef43 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6867c020bf2a4db3b0a4cebb32c64aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea45368b61d4748a164cc6b76293749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:19.782586 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-6a7308d8-865a-44d7-b08e-6775429cef43 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24" status: 200 len: 1359 microversion: 2.1 time: 0.158212 Jun 23 22:47:19.785746 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 496/1018] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:19 2022] GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:20.803741 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-55b58740-0924-4b29-b246-a958abc8fd4e tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:20.804625 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-55b58740-0924-4b29-b246-a958abc8fd4e tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:20.807070 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:47:20.812739 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-55b58740-0924-4b29-b246-a958abc8fd4e tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:20.813703 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-55b58740-0924-4b29-b246-a958abc8fd4e tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:20.814544 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-55b58740-0924-4b29-b246-a958abc8fd4e tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:20.815693 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-55b58740-0924-4b29-b246-a958abc8fd4e tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:20.974243 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-55b58740-0924-4b29-b246-a958abc8fd4e tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6867c020bf2a4db3b0a4cebb32c64aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea45368b61d4748a164cc6b76293749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:20.982819 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-55b58740-0924-4b29-b246-a958abc8fd4e tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24" status: 200 len: 1359 microversion: 2.1 time: 0.184471 Jun 23 22:47:20.993500 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 523/1019] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:20 2022] GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24 => generated 1359 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:21.999699 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a045951f-8ed7-4c7e-aed1-4a8bfe72096a tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:22.000336 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-a045951f-8ed7-4c7e-aed1-4a8bfe72096a tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:22.007825 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a045951f-8ed7-4c7e-aed1-4a8bfe72096a tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:22.008267 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a045951f-8ed7-4c7e-aed1-4a8bfe72096a tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:22.009150 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a045951f-8ed7-4c7e-aed1-4a8bfe72096a tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:22.009492 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a045951f-8ed7-4c7e-aed1-4a8bfe72096a tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:22.156217 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-a045951f-8ed7-4c7e-aed1-4a8bfe72096a tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6867c020bf2a4db3b0a4cebb32c64aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea45368b61d4748a164cc6b76293749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:22.168011 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-a045951f-8ed7-4c7e-aed1-4a8bfe72096a tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24" status: 200 len: 1359 microversion: 2.1 time: 0.172018 Jun 23 22:47:22.169170 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 497/1020] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:21 2022] GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:23.186590 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-73ecfa0f-98c6-4802-8037-1ce50c50034a tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:23.187227 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-73ecfa0f-98c6-4802-8037-1ce50c50034a tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:23.195128 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-73ecfa0f-98c6-4802-8037-1ce50c50034a tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:23.195579 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-73ecfa0f-98c6-4802-8037-1ce50c50034a tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:23.196352 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-73ecfa0f-98c6-4802-8037-1ce50c50034a tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:23.196784 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-73ecfa0f-98c6-4802-8037-1ce50c50034a tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:23.338419 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-73ecfa0f-98c6-4802-8037-1ce50c50034a tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6867c020bf2a4db3b0a4cebb32c64aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea45368b61d4748a164cc6b76293749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:23.346718 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-73ecfa0f-98c6-4802-8037-1ce50c50034a tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24" status: 200 len: 1359 microversion: 2.1 time: 0.163604 Jun 23 22:47:23.347349 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 524/1021] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:23 2022] GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:24.363649 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-0a6f7b51-447e-4564-a4c8-17806a579f69 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:24.364355 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-0a6f7b51-447e-4564-a4c8-17806a579f69 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:24.371027 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0a6f7b51-447e-4564-a4c8-17806a579f69 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:24.371477 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0a6f7b51-447e-4564-a4c8-17806a579f69 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:24.372318 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0a6f7b51-447e-4564-a4c8-17806a579f69 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:24.372752 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0a6f7b51-447e-4564-a4c8-17806a579f69 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:24.504220 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-0a6f7b51-447e-4564-a4c8-17806a579f69 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6867c020bf2a4db3b0a4cebb32c64aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea45368b61d4748a164cc6b76293749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:24.511601 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-0a6f7b51-447e-4564-a4c8-17806a579f69 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24" status: 200 len: 1359 microversion: 2.1 time: 0.152528 Jun 23 22:47:24.512162 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 498/1022] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:24 2022] GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:25.528683 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-8bbfb3f6-f9b3-49cc-af9a-a498cfcdd6a8 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:25.529367 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-8bbfb3f6-f9b3-49cc-af9a-a498cfcdd6a8 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:25.531666 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell0:SELECT=2 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:47:25.532331 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell0:SELECT=6 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:47:25.538520 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-8bbfb3f6-f9b3-49cc-af9a-a498cfcdd6a8 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:25.538990 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-8bbfb3f6-f9b3-49cc-af9a-a498cfcdd6a8 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:25.539765 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-8bbfb3f6-f9b3-49cc-af9a-a498cfcdd6a8 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:25.540197 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-8bbfb3f6-f9b3-49cc-af9a-a498cfcdd6a8 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:25.544709 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell1:SELECT=80 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:47:25.579707 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-4ffda644-dac3-433b-9ffd-c0aeb8adef16 req-fd462871-8d6e-42e8-b0d6-7827280bdc45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1d677cc-4aa2-43b3-802a-ef29bf811b24", "tag": "fdbb6199-e947-45ff-aadd-1b4eb33cf84b"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:47:25.585585 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=6 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:47:25.597851 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-4ffda644-dac3-433b-9ffd-c0aeb8adef16 req-fd462871-8d6e-42e8-b0d6-7827280bdc45 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:25.598431 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-4ffda644-dac3-433b-9ffd-c0aeb8adef16 req-fd462871-8d6e-42e8-b0d6-7827280bdc45 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:25.611337 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-4ffda644-dac3-433b-9ffd-c0aeb8adef16 req-fd462871-8d6e-42e8-b0d6-7827280bdc45 service nova] Creating event network-changed:fdbb6199-e947-45ff-aadd-1b4eb33cf84b for instance e1d677cc-4aa2-43b3-802a-ef29bf811b24 on hv-cinder-84617 Jun 23 22:47:25.618255 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-4ffda644-dac3-433b-9ffd-c0aeb8adef16 req-fd462871-8d6e-42e8-b0d6-7827280bdc45 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042170 Jun 23 22:47:25.619147 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 499/1023] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:47:25.772486 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-8bbfb3f6-f9b3-49cc-af9a-a498cfcdd6a8 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6867c020bf2a4db3b0a4cebb32c64aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea45368b61d4748a164cc6b76293749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:25.780443 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-8bbfb3f6-f9b3-49cc-af9a-a498cfcdd6a8 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24" status: 200 len: 1359 microversion: 2.1 time: 0.255693 Jun 23 22:47:25.781026 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 525/1024] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:25 2022] GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24 => generated 1359 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:26.799102 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-184faa0f-8d5c-4b22-8909-dc4c9721b08b tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:26.799863 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-184faa0f-8d5c-4b22-8909-dc4c9721b08b tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:26.808331 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-184faa0f-8d5c-4b22-8909-dc4c9721b08b tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:26.808770 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-184faa0f-8d5c-4b22-8909-dc4c9721b08b tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:26.809521 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-184faa0f-8d5c-4b22-8909-dc4c9721b08b tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:26.809947 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-184faa0f-8d5c-4b22-8909-dc4c9721b08b tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:26.947219 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-184faa0f-8d5c-4b22-8909-dc4c9721b08b tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6867c020bf2a4db3b0a4cebb32c64aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea45368b61d4748a164cc6b76293749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:26.954560 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-184faa0f-8d5c-4b22-8909-dc4c9721b08b tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24" status: 200 len: 1359 microversion: 2.1 time: 0.160327 Jun 23 22:47:26.955165 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 500/1025] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:26 2022] GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:27.971663 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-c6016dbb-a596-4151-946d-f6329a5d1038 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:27.972250 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-c6016dbb-a596-4151-946d-f6329a5d1038 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:27.978745 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c6016dbb-a596-4151-946d-f6329a5d1038 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:27.979221 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c6016dbb-a596-4151-946d-f6329a5d1038 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:27.979990 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c6016dbb-a596-4151-946d-f6329a5d1038 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:27.980421 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-c6016dbb-a596-4151-946d-f6329a5d1038 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:28.109876 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-c6016dbb-a596-4151-946d-f6329a5d1038 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6867c020bf2a4db3b0a4cebb32c64aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea45368b61d4748a164cc6b76293749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:28.117974 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-c6016dbb-a596-4151-946d-f6329a5d1038 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24" status: 200 len: 1359 microversion: 2.1 time: 0.150405 Jun 23 22:47:28.118546 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 526/1026] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:27 2022] GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:29.135510 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-cb03e1c3-d837-4253-9685-0ea883783c5a tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:29.136125 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-cb03e1c3-d837-4253-9685-0ea883783c5a tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:29.143887 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cb03e1c3-d837-4253-9685-0ea883783c5a tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:29.144340 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cb03e1c3-d837-4253-9685-0ea883783c5a tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:29.145108 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cb03e1c3-d837-4253-9685-0ea883783c5a tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:29.145551 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-cb03e1c3-d837-4253-9685-0ea883783c5a tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:29.272211 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-cb03e1c3-d837-4253-9685-0ea883783c5a tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6867c020bf2a4db3b0a4cebb32c64aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea45368b61d4748a164cc6b76293749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:29.280294 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-cb03e1c3-d837-4253-9685-0ea883783c5a tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24" status: 200 len: 1359 microversion: 2.1 time: 0.148689 Jun 23 22:47:29.280889 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 501/1027] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:29 2022] GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:30.297770 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-1b768fcd-2c55-44ab-a869-9d7b23824e03 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:30.298388 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-1b768fcd-2c55-44ab-a869-9d7b23824e03 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:30.305422 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1b768fcd-2c55-44ab-a869-9d7b23824e03 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:30.305876 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1b768fcd-2c55-44ab-a869-9d7b23824e03 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:30.306649 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1b768fcd-2c55-44ab-a869-9d7b23824e03 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:30.307118 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1b768fcd-2c55-44ab-a869-9d7b23824e03 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:30.441971 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-1b768fcd-2c55-44ab-a869-9d7b23824e03 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6867c020bf2a4db3b0a4cebb32c64aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea45368b61d4748a164cc6b76293749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:30.449489 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-1b768fcd-2c55-44ab-a869-9d7b23824e03 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24" status: 200 len: 1359 microversion: 2.1 time: 0.155869 Jun 23 22:47:30.450055 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 527/1028] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:30 2022] GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:31.467836 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-411411e2-3b04-4c87-9528-5c15c1606907 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:31.468372 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-411411e2-3b04-4c87-9528-5c15c1606907 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:31.475021 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-411411e2-3b04-4c87-9528-5c15c1606907 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:31.475465 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-411411e2-3b04-4c87-9528-5c15c1606907 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:31.476250 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-411411e2-3b04-4c87-9528-5c15c1606907 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:31.476678 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-411411e2-3b04-4c87-9528-5c15c1606907 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:31.602095 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-411411e2-3b04-4c87-9528-5c15c1606907 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6867c020bf2a4db3b0a4cebb32c64aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea45368b61d4748a164cc6b76293749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:31.609433 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-411411e2-3b04-4c87-9528-5c15c1606907 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24" status: 200 len: 1359 microversion: 2.1 time: 0.145642 Jun 23 22:47:31.609990 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 502/1029] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:31 2022] GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24 => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:32.335279 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [req-342a11ee-f4b5-449b-bd93-dab2fe73a44e req-1e241f95-8eda-44e7-b785-b43d0850110a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1d677cc-4aa2-43b3-802a-ef29bf811b24", "name": "network-vif-plugged", "status": "completed", "tag": "fdbb6199-e947-45ff-aadd-1b4eb33cf84b"}]} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:47:32.343911 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-342a11ee-f4b5-449b-bd93-dab2fe73a44e req-1e241f95-8eda-44e7-b785-b43d0850110a service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:32.344351 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-342a11ee-f4b5-449b-bd93-dab2fe73a44e req-1e241f95-8eda-44e7-b785-b43d0850110a service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:32.358276 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.compute.server_external_events [req-342a11ee-f4b5-449b-bd93-dab2fe73a44e req-1e241f95-8eda-44e7-b785-b43d0850110a service nova] Creating event network-vif-plugged:fdbb6199-e947-45ff-aadd-1b4eb33cf84b for instance e1d677cc-4aa2-43b3-802a-ef29bf811b24 on hv-cinder-84617 Jun 23 22:47:32.364065 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [req-342a11ee-f4b5-449b-bd93-dab2fe73a44e req-1e241f95-8eda-44e7-b785-b43d0850110a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032576 Jun 23 22:47:32.364675 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 528/1030] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:47:32.626475 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-78c6f279-6e29-41ce-8227-dee4e2ffb48e tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:32.627954 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-78c6f279-6e29-41ce-8227-dee4e2ffb48e tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:32.634430 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-78c6f279-6e29-41ce-8227-dee4e2ffb48e tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:32.634878 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-78c6f279-6e29-41ce-8227-dee4e2ffb48e tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:32.635681 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-78c6f279-6e29-41ce-8227-dee4e2ffb48e tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:32.636116 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-78c6f279-6e29-41ce-8227-dee4e2ffb48e tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:32.775097 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-78c6f279-6e29-41ce-8227-dee4e2ffb48e tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6867c020bf2a4db3b0a4cebb32c64aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea45368b61d4748a164cc6b76293749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:32.782543 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-78c6f279-6e29-41ce-8227-dee4e2ffb48e tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24" status: 200 len: 1359 microversion: 2.1 time: 0.159889 Jun 23 22:47:32.783740 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 503/1031] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:32 2022] GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:33.801132 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-26ac7989-39b6-4eab-8984-00d1a82a2b07 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:33.801832 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-26ac7989-39b6-4eab-8984-00d1a82a2b07 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:33.808031 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-26ac7989-39b6-4eab-8984-00d1a82a2b07 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:33.808475 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-26ac7989-39b6-4eab-8984-00d1a82a2b07 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:33.809231 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-26ac7989-39b6-4eab-8984-00d1a82a2b07 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:33.809661 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-26ac7989-39b6-4eab-8984-00d1a82a2b07 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:33.937478 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-26ac7989-39b6-4eab-8984-00d1a82a2b07 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6867c020bf2a4db3b0a4cebb32c64aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea45368b61d4748a164cc6b76293749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:33.944919 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-26ac7989-39b6-4eab-8984-00d1a82a2b07 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24" status: 200 len: 1359 microversion: 2.1 time: 0.148530 Jun 23 22:47:33.945481 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 529/1032] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:33 2022] GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:34.962362 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-202886a2-f727-492d-8ff8-1abda0b5d291 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:34.962954 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-202886a2-f727-492d-8ff8-1abda0b5d291 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:34.970416 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-202886a2-f727-492d-8ff8-1abda0b5d291 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:34.971169 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-202886a2-f727-492d-8ff8-1abda0b5d291 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:34.971977 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-202886a2-f727-492d-8ff8-1abda0b5d291 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:34.972417 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-202886a2-f727-492d-8ff8-1abda0b5d291 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:35.117587 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-202886a2-f727-492d-8ff8-1abda0b5d291 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6867c020bf2a4db3b0a4cebb32c64aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea45368b61d4748a164cc6b76293749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:35.125739 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-202886a2-f727-492d-8ff8-1abda0b5d291 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24" status: 200 len: 1549 microversion: 2.1 time: 0.167468 Jun 23 22:47:35.126569 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 504/1033] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:34 2022] GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24 => generated 1549 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:35.143299 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-95851ef2-ed44-4618-ad5d-e7b87d5d3f78 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:35.143919 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-95851ef2-ed44-4618-ad5d-e7b87d5d3f78 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:35.150459 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-95851ef2-ed44-4618-ad5d-e7b87d5d3f78 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:35.150907 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-95851ef2-ed44-4618-ad5d-e7b87d5d3f78 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:35.151732 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-95851ef2-ed44-4618-ad5d-e7b87d5d3f78 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:35.152190 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-95851ef2-ed44-4618-ad5d-e7b87d5d3f78 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:35.280456 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-95851ef2-ed44-4618-ad5d-e7b87d5d3f78 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6867c020bf2a4db3b0a4cebb32c64aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea45368b61d4748a164cc6b76293749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:35.288471 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-95851ef2-ed44-4618-ad5d-e7b87d5d3f78 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24" status: 200 len: 1549 microversion: 2.1 time: 0.149269 Jun 23 22:47:35.289035 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 530/1034] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:35 2022] GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24 => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:35.305092 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a9f4c777-bd1b-45ce-b80d-ff5a5bd41d1c tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:35.308739 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-a9f4c777-bd1b-45ce-b80d-ff5a5bd41d1c tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6867c020bf2a4db3b0a4cebb32c64aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea45368b61d4748a164cc6b76293749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:35.309537 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-a9f4c777-bd1b-45ce-b80d-ff5a5bd41d1c tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Searching by: {'deleted': False, 'project_id': 'cea45368b61d4748a164cc6b76293749'} {{(pid=124358) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 23 22:47:35.316486 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a9f4c777-bd1b-45ce-b80d-ff5a5bd41d1c tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:35.316938 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a9f4c777-bd1b-45ce-b80d-ff5a5bd41d1c tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:35.317749 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a9f4c777-bd1b-45ce-b80d-ff5a5bd41d1c tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:35.318184 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a9f4c777-bd1b-45ce-b80d-ff5a5bd41d1c tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:35.406040 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.multi_cell_list [None req-a9f4c777-bd1b-45ce-b80d-ff5a5bd41d1c tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124358) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 23 22:47:35.500027 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-a9f4c777-bd1b-45ce-b80d-ff5a5bd41d1c tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.198797 Jun 23 22:47:35.500535 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 505/1035] 10.222.0.43 () {58 vars in 1124 bytes} [Thu Jun 23 22:47:35 2022] GET /compute/v2.1/servers => generated 343 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:47:35.510679 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-fed467c5-443c-472c-bdc5-b7c94997a5d4 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:35.511316 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-fed467c5-443c-472c-bdc5-b7c94997a5d4 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:35.517850 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fed467c5-443c-472c-bdc5-b7c94997a5d4 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:35.518218 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fed467c5-443c-472c-bdc5-b7c94997a5d4 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:35.518965 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fed467c5-443c-472c-bdc5-b7c94997a5d4 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:35.519390 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-fed467c5-443c-472c-bdc5-b7c94997a5d4 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:35.648994 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-fed467c5-443c-472c-bdc5-b7c94997a5d4 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6867c020bf2a4db3b0a4cebb32c64aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea45368b61d4748a164cc6b76293749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:35.656441 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-fed467c5-443c-472c-bdc5-b7c94997a5d4 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24" status: 200 len: 1549 microversion: 2.1 time: 0.149641 Jun 23 22:47:35.656999 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 531/1036] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:35 2022] GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24 => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:37.193581 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-f8cff030-14eb-4977-a458-59c942df4cc3 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2733656-68ec-4796-a373-57e7ca88bfe3"}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:47:37.194683 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-f8cff030-14eb-4977-a458-59c942df4cc3 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:37.201503 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f8cff030-14eb-4977-a458-59c942df4cc3 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:37.201956 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f8cff030-14eb-4977-a458-59c942df4cc3 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:37.202724 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f8cff030-14eb-4977-a458-59c942df4cc3 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:37.203190 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-f8cff030-14eb-4977-a458-59c942df4cc3 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:37.460941 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-f8cff030-14eb-4977-a458-59c942df4cc3 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "POST /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271387 Jun 23 22:47:37.461605 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 506/1037] 10.222.0.43 () {60 vars in 1322 bytes} [Thu Jun 23 22:47:37 2022] POST /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:47:39.374435 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-1454bce2-72c6-4980-bf2c-505c1bf327ee tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:39.375380 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-1454bce2-72c6-4980-bf2c-505c1bf327ee tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:39.382004 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1454bce2-72c6-4980-bf2c-505c1bf327ee tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:39.382383 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1454bce2-72c6-4980-bf2c-505c1bf327ee tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:39.383177 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1454bce2-72c6-4980-bf2c-505c1bf327ee tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:39.383611 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-1454bce2-72c6-4980-bf2c-505c1bf327ee tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:39.415541 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-1454bce2-72c6-4980-bf2c-505c1bf327ee tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044964 Jun 23 22:47:39.416110 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 532/1038] 10.222.0.43 () {60 vars in 1342 bytes} [Thu Jun 23 22:47:39 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:39.477097 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-1141bba5-5b0e-4048-9e6b-eef9270f01eb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:39.478273 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-1141bba5-5b0e-4048-9e6b-eef9270f01eb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:39.484635 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1141bba5-5b0e-4048-9e6b-eef9270f01eb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:39.485086 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1141bba5-5b0e-4048-9e6b-eef9270f01eb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:39.485940 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1141bba5-5b0e-4048-9e6b-eef9270f01eb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:39.486376 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1141bba5-5b0e-4048-9e6b-eef9270f01eb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:39.510835 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-1141bba5-5b0e-4048-9e6b-eef9270f01eb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Going to try to terminate instance {{(pid=124358) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:47:39.590313 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-1141bba5-5b0e-4048-9e6b-eef9270f01eb tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 204 len: 0 microversion: 2.20 time: 0.117850 Jun 23 22:47:39.591179 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 507/1039] 10.222.0.43 () {60 vars in 1279 bytes} [Thu Jun 23 22:47:39 2022] DELETE /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 23 22:47:39.599886 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-4192910e-7ded-4f08-9c60-d31309d92be0 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:39.600491 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-4192910e-7ded-4f08-9c60-d31309d92be0 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:39.607482 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-4192910e-7ded-4f08-9c60-d31309d92be0 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:39.607930 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-4192910e-7ded-4f08-9c60-d31309d92be0 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:39.608705 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-4192910e-7ded-4f08-9c60-d31309d92be0 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:39.609167 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-4192910e-7ded-4f08-9c60-d31309d92be0 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:39.742029 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-4192910e-7ded-4f08-9c60-d31309d92be0 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:39.749908 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-4192910e-7ded-4f08-9c60-d31309d92be0 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:39.751974 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-4192910e-7ded-4f08-9c60-d31309d92be0 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:39.753122 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-4192910e-7ded-4f08-9c60-d31309d92be0 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1722 microversion: 2.20 time: 0.157160 Jun 23 22:47:39.753674 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 533/1040] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:47:39 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:47:40.772747 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-329fcb2c-f77d-49e3-980c-6756fea65509 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:40.773446 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-329fcb2c-f77d-49e3-980c-6756fea65509 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:40.779929 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-329fcb2c-f77d-49e3-980c-6756fea65509 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:40.780371 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-329fcb2c-f77d-49e3-980c-6756fea65509 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:40.781123 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-329fcb2c-f77d-49e3-980c-6756fea65509 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:40.781548 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-329fcb2c-f77d-49e3-980c-6756fea65509 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:40.915673 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-329fcb2c-f77d-49e3-980c-6756fea65509 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:40.919471 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:47:40.925628 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-329fcb2c-f77d-49e3-980c-6756fea65509 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:40.927364 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-329fcb2c-f77d-49e3-980c-6756fea65509 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:40.928694 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-329fcb2c-f77d-49e3-980c-6756fea65509 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1722 microversion: 2.20 time: 0.160541 Jun 23 22:47:40.929304 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 508/1041] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:47:40 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:47:41.948259 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-3b8ef669-50b7-418d-a0c2-e929b9d91f2b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:41.948910 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-3b8ef669-50b7-418d-a0c2-e929b9d91f2b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:41.955383 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3b8ef669-50b7-418d-a0c2-e929b9d91f2b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:41.955831 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3b8ef669-50b7-418d-a0c2-e929b9d91f2b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:41.956604 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3b8ef669-50b7-418d-a0c2-e929b9d91f2b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:41.957037 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-3b8ef669-50b7-418d-a0c2-e929b9d91f2b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:41.989822 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-35ea5408-bdc0-43fd-a641-6f52a7b80699 req-92de57fe-ba59-4cef-886c-4839d0a931bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe4cae6a-0365-477a-bbcb-100245e62715", "name": "network-vif-deleted", "tag": "ca42cad6-fa77-4fa7-b9e0-48ce41a63154"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:47:42.008082 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-35ea5408-bdc0-43fd-a641-6f52a7b80699 req-92de57fe-ba59-4cef-886c-4839d0a931bc service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:42.008679 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-35ea5408-bdc0-43fd-a641-6f52a7b80699 req-92de57fe-ba59-4cef-886c-4839d0a931bc service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:42.024536 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-35ea5408-bdc0-43fd-a641-6f52a7b80699 req-92de57fe-ba59-4cef-886c-4839d0a931bc service nova] Creating event network-vif-deleted:ca42cad6-fa77-4fa7-b9e0-48ce41a63154 for instance fe4cae6a-0365-477a-bbcb-100245e62715 on hv-cinder-84617 Jun 23 22:47:42.030011 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-35ea5408-bdc0-43fd-a641-6f52a7b80699 req-92de57fe-ba59-4cef-886c-4839d0a931bc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046855 Jun 23 22:47:42.031266 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 509/1042] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:47:42.038050 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-3b8ef669-50b7-418d-a0c2-e929b9d91f2b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:42.049138 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-3b8ef669-50b7-418d-a0c2-e929b9d91f2b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:42.050667 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-3b8ef669-50b7-418d-a0c2-e929b9d91f2b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1a93ea9f0a3f47d68e53c464c1d52c92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ab3a2e6c9634a06b33f1d82a28dc3f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:42.054353 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-3b8ef669-50b7-418d-a0c2-e929b9d91f2b tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 200 len: 1654 microversion: 2.20 time: 0.110544 Jun 23 22:47:42.066333 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 534/1043] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:47:41 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 1654 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:47:43.074497 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-5ca654f5-7e26-4041-99a4-19328687bd52 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:43.075167 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-5ca654f5-7e26-4041-99a4-19328687bd52 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:43.082355 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5ca654f5-7e26-4041-99a4-19328687bd52 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:43.082830 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5ca654f5-7e26-4041-99a4-19328687bd52 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:43.083639 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5ca654f5-7e26-4041-99a4-19328687bd52 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:43.084067 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-5ca654f5-7e26-4041-99a4-19328687bd52 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:43.098729 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-5ca654f5-7e26-4041-99a4-19328687bd52 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] HTTP exception thrown: Instance fe4cae6a-0365-477a-bbcb-100245e62715 could not be found. Jun 23 22:47:43.100437 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-5ca654f5-7e26-4041-99a4-19328687bd52 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Request method failure captured: Jun 23 22:47:43.100437 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: request: GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 HTTP/1.1 Jun 23 22:47:43.100437 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept: application/json Jun 23 22:47:43.100437 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Jun 23 22:47:43.100437 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Connection: close Jun 23 22:47:43.100437 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Length: 0 Jun 23 22:47:43.100437 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Type: application/json Jun 23 22:47:43.100437 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Host: 10.222.0.43 Jun 23 22:47:43.100437 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Jun 23 22:47:43.100437 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.9 Jun 23 22:47:43.100437 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABitOw0MOa6BWaAt76FiQb8wWjlkd6hLuW8KhNVqtFEeH7Vws1c7QV4QlDvvx1Ug-8Yn5zV2V6vcx0uASju7DUTyb3QJ1o8IVd5RMaIPwt_Hv-mRoZHqYWgBD-pTirG_gG7jFYX5SE0xzTE7P_w_QLEw6Zoh8UwLtYv-hyiNcCSTo9V-bM Jun 23 22:47:43.100437 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Jun 23 22:47:43.100437 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Jun 23 22:47:43.100437 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Jun 23 22:47:43.100437 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Jun 23 22:47:43.100437 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 22:47:43.100437 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Jun 23 22:47:43.100437 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Jun 23 22:47:43.100437 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Id: 9ab3a2e6c9634a06b33f1d82a28dc3f1 Jun 23 22:47:43.100437 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-543397818 Jun 23 22:47:43.100437 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Role: reader,member Jun 23 22:47:43.100437 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Roles: reader,member Jun 23 22:47:43.102344 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9ab3a2e6c9634a06b33f1d82a28dc3f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9ab3a2e6c9634a06b33f1d82a28dc3f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9ab3a2e6c9634a06b33f1d82a28dc3f1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9ab3a2e6c9634a06b33f1d82a28dc3f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:47:43.102344 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-AttachVolumeShelveTestJSON-543397818 Jun 23 22:47:43.102344 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Id: 9ab3a2e6c9634a06b33f1d82a28dc3f1 Jun 23 22:47:43.102344 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-543397818 Jun 23 22:47:43.102344 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User: tempest-AttachVolumeShelveTestJSON-543397818-project Jun 23 22:47:43.102344 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Jun 23 22:47:43.102344 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Jun 23 22:47:43.102344 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Id: 1a93ea9f0a3f47d68e53c464c1d52c92 Jun 23 22:47:43.102344 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-AttachVolumeShelveTestJSON-543397818-project Jun 23 22:47:43.102344 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: method: > Jun 23 22:47:43.102344 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: exception: Instance fe4cae6a-0365-477a-bbcb-100245e62715 could not be found. Jun 23 22:47:43.102344 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: action_args: {'id': 'fe4cae6a-0365-477a-bbcb-100245e62715'} Jun 23 22:47:43.103331 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:47:43.103331 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:47:43.103331 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:47:43.103331 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:47:43.103331 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:47:43.103331 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:47:43.103331 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:47:43.103331 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:47:43.103331 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:47:43.103331 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:47:43.103331 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe4cae6a-0365-477a-bbcb-100245e62715 could not be found. Jun 23 22:47:43.103331 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:47:43.103331 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:47:43.103331 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:47:43.103331 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:47:43.103331 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:47:43.103331 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:47:43.103331 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:47:43.103331 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:47:43.103331 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:47:43.104961 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:47:43.104961 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:47:43.104961 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:47:43.104961 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:47:43.104961 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:47:43.104961 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:47:43.104961 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:47:43.104961 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe4cae6a-0365-477a-bbcb-100245e62715 could not be found. Jun 23 22:47:43.104961 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:47:43.104961 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:47:43.104961 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:47:43.104961 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:47:43.104961 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:47:43.104961 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:47:43.104961 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:47:43.104961 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:47:43.104961 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe4cae6a-0365-477a-bbcb-100245e62715 could not be found. Jun 23 22:47:43.104961 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:47:43.106533 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-5ca654f5-7e26-4041-99a4-19328687bd52 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Returning 404 to user: Instance fe4cae6a-0365-477a-bbcb-100245e62715 could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:47:43.106533 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-5ca654f5-7e26-4041-99a4-19328687bd52 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 404 len: 111 microversion: 2.20 time: 0.032477 Jun 23 22:47:43.106533 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 510/1044] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:47:43 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 22:47:43.111938 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-2ad2e743-ae50-499e-8b03-a8af16ec6cdd tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '.version_select at 0x7fb7195f94c0>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:43.132121 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-2ad2e743-ae50-499e-8b03-a8af16ec6cdd tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1541421143" status: 204 len: 0 microversion: 2.20 time: 0.024504 Jun 23 22:47:43.132971 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 535/1045] 10.222.0.43 () {60 vars in 1261 bytes} [Thu Jun 23 22:47:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1541421143 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 23 22:47:43.997177 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-3dc86e60-d469-468e-a5a5-5f528b8016db tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:43.997807 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-3dc86e60-d469-468e-a5a5-5f528b8016db tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:44.005000 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3dc86e60-d469-468e-a5a5-5f528b8016db tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:44.005453 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3dc86e60-d469-468e-a5a5-5f528b8016db tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:44.006291 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3dc86e60-d469-468e-a5a5-5f528b8016db tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:44.006724 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-3dc86e60-d469-468e-a5a5-5f528b8016db tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:44.138093 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-3dc86e60-d469-468e-a5a5-5f528b8016db tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6867c020bf2a4db3b0a4cebb32c64aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea45368b61d4748a164cc6b76293749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:44.146396 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-3dc86e60-d469-468e-a5a5-5f528b8016db tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24" status: 200 len: 1595 microversion: 2.1 time: 0.153248 Jun 23 22:47:44.146971 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 511/1046] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:43 2022] GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24 => generated 1595 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:44.895874 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-d78dc740-241b-48e8-8f37-462353255d9f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:44.896518 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-d78dc740-241b-48e8-8f37-462353255d9f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:44.903225 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d78dc740-241b-48e8-8f37-462353255d9f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:44.903757 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d78dc740-241b-48e8-8f37-462353255d9f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:44.904592 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d78dc740-241b-48e8-8f37-462353255d9f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:44.905092 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-d78dc740-241b-48e8-8f37-462353255d9f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:44.920148 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.wsgi [None req-d78dc740-241b-48e8-8f37-462353255d9f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] HTTP exception thrown: Instance fe4cae6a-0365-477a-bbcb-100245e62715 could not be found. Jun 23 22:47:44.922009 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-d78dc740-241b-48e8-8f37-462353255d9f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Request method failure captured: Jun 23 22:47:44.922009 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: request: DELETE /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 HTTP/1.1 Jun 23 22:47:44.922009 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept: application/json Jun 23 22:47:44.922009 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept-Encoding: identity Jun 23 22:47:44.922009 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Connection: close Jun 23 22:47:44.922009 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Length: 0 Jun 23 22:47:44.922009 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Type: application/json Jun 23 22:47:44.922009 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Host: 10.222.0.43 Jun 23 22:47:44.922009 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Openstack-System-Scope: None Jun 23 22:47:44.922009 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: User-Agent: python-urllib3/1.26.9 Jun 23 22:47:44.922009 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Auth-Token: gAAAAABitOw0MOa6BWaAt76FiQb8wWjlkd6hLuW8KhNVqtFEeH7Vws1c7QV4QlDvvx1Ug-8Yn5zV2V6vcx0uASju7DUTyb3QJ1o8IVd5RMaIPwt_Hv-mRoZHqYWgBD-pTirG_gG7jFYX5SE0xzTE7P_w_QLEw6Zoh8UwLtYv-hyiNcCSTo9V-bM Jun 23 22:47:44.922009 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Id: None Jun 23 22:47:44.922009 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Name: None Jun 23 22:47:44.922009 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Identity-Status: Confirmed Jun 23 22:47:44.922009 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Is-Admin-Project: True Jun 23 22:47:44.922009 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 22:47:44.922009 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Id: default Jun 23 22:47:44.922009 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Name: Default Jun 23 22:47:44.922009 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Id: 9ab3a2e6c9634a06b33f1d82a28dc3f1 Jun 23 22:47:44.922009 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-543397818 Jun 23 22:47:44.922009 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Role: reader,member Jun 23 22:47:44.922009 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Roles: reader,member Jun 23 22:47:44.924543 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9ab3a2e6c9634a06b33f1d82a28dc3f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9ab3a2e6c9634a06b33f1d82a28dc3f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9ab3a2e6c9634a06b33f1d82a28dc3f1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9ab3a2e6c9634a06b33f1d82a28dc3f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:47:44.924543 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant: tempest-AttachVolumeShelveTestJSON-543397818 Jun 23 22:47:44.924543 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Id: 9ab3a2e6c9634a06b33f1d82a28dc3f1 Jun 23 22:47:44.924543 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-543397818 Jun 23 22:47:44.924543 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User: tempest-AttachVolumeShelveTestJSON-543397818-project Jun 23 22:47:44.924543 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Id: default Jun 23 22:47:44.924543 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Name: Default Jun 23 22:47:44.924543 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Id: 1a93ea9f0a3f47d68e53c464c1d52c92 Jun 23 22:47:44.924543 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Name: tempest-AttachVolumeShelveTestJSON-543397818-project Jun 23 22:47:44.924543 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: method: > Jun 23 22:47:44.924543 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: exception: Instance fe4cae6a-0365-477a-bbcb-100245e62715 could not be found. Jun 23 22:47:44.924543 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: action_args: {'id': 'fe4cae6a-0365-477a-bbcb-100245e62715'} Jun 23 22:47:44.925373 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:47:44.925373 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:47:44.925373 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:47:44.925373 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:47:44.925373 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:47:44.925373 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:47:44.925373 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:47:44.925373 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:47:44.925373 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:47:44.925373 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:47:44.925373 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe4cae6a-0365-477a-bbcb-100245e62715 could not be found. Jun 23 22:47:44.925373 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:47:44.925373 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:47:44.925373 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:47:44.925373 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:47:44.925373 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:47:44.925373 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:47:44.925373 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:47:44.925373 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:47:44.925373 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:47:44.926723 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:47:44.926723 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 22:47:44.926723 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 22:47:44.926723 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 22:47:44.926723 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 22:47:44.926723 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:47:44.926723 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:47:44.926723 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:47:44.926723 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:47:44.926723 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe4cae6a-0365-477a-bbcb-100245e62715 could not be found. Jun 23 22:47:44.926723 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:47:44.926723 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:47:44.926723 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:47:44.926723 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:47:44.926723 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:47:44.926723 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:47:44.926723 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:47:44.926723 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:47:44.926723 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe4cae6a-0365-477a-bbcb-100245e62715 could not be found. Jun 23 22:47:44.926723 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:47:44.928630 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-d78dc740-241b-48e8-8f37-462353255d9f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Returning 404 to user: Instance fe4cae6a-0365-477a-bbcb-100245e62715 could not be found. {{(pid=124357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:47:44.928630 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-d78dc740-241b-48e8-8f37-462353255d9f tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "DELETE /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 404 len: 111 microversion: 2.20 time: 0.033172 Jun 23 22:47:44.928630 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 536/1047] 10.222.0.43 () {60 vars in 1279 bytes} [Thu Jun 23 22:47:44 2022] DELETE /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 22:47:44.933900 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-7d6c560b-c018-4b82-8434-1da8530e514a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:44.934502 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-7d6c560b-c018-4b82-8434-1da8530e514a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: fe4cae6a-0365-477a-bbcb-100245e62715] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:44.936446 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:47:44.941960 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7d6c560b-c018-4b82-8434-1da8530e514a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:44.942396 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7d6c560b-c018-4b82-8434-1da8530e514a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:44.943184 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7d6c560b-c018-4b82-8434-1da8530e514a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:44.943610 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7d6c560b-c018-4b82-8434-1da8530e514a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:44.959138 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-7d6c560b-c018-4b82-8434-1da8530e514a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] HTTP exception thrown: Instance fe4cae6a-0365-477a-bbcb-100245e62715 could not be found. Jun 23 22:47:44.960598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-7d6c560b-c018-4b82-8434-1da8530e514a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Request method failure captured: Jun 23 22:47:44.960598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: request: GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 HTTP/1.1 Jun 23 22:47:44.960598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept: application/json Jun 23 22:47:44.960598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Jun 23 22:47:44.960598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Connection: close Jun 23 22:47:44.960598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Length: 0 Jun 23 22:47:44.960598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Type: application/json Jun 23 22:47:44.960598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Host: 10.222.0.43 Jun 23 22:47:44.960598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Jun 23 22:47:44.960598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.9 Jun 23 22:47:44.960598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABitOw0MOa6BWaAt76FiQb8wWjlkd6hLuW8KhNVqtFEeH7Vws1c7QV4QlDvvx1Ug-8Yn5zV2V6vcx0uASju7DUTyb3QJ1o8IVd5RMaIPwt_Hv-mRoZHqYWgBD-pTirG_gG7jFYX5SE0xzTE7P_w_QLEw6Zoh8UwLtYv-hyiNcCSTo9V-bM Jun 23 22:47:44.960598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Jun 23 22:47:44.960598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Jun 23 22:47:44.960598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Jun 23 22:47:44.960598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Jun 23 22:47:44.960598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 22:47:44.960598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Jun 23 22:47:44.960598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Jun 23 22:47:44.960598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Id: 9ab3a2e6c9634a06b33f1d82a28dc3f1 Jun 23 22:47:44.960598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-543397818 Jun 23 22:47:44.960598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Role: reader,member Jun 23 22:47:44.960598 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Roles: reader,member Jun 23 22:47:44.962382 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9ab3a2e6c9634a06b33f1d82a28dc3f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9ab3a2e6c9634a06b33f1d82a28dc3f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9ab3a2e6c9634a06b33f1d82a28dc3f1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9ab3a2e6c9634a06b33f1d82a28dc3f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:47:44.962382 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-AttachVolumeShelveTestJSON-543397818 Jun 23 22:47:44.962382 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Id: 9ab3a2e6c9634a06b33f1d82a28dc3f1 Jun 23 22:47:44.962382 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-543397818 Jun 23 22:47:44.962382 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User: tempest-AttachVolumeShelveTestJSON-543397818-project Jun 23 22:47:44.962382 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Jun 23 22:47:44.962382 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Jun 23 22:47:44.962382 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Id: 1a93ea9f0a3f47d68e53c464c1d52c92 Jun 23 22:47:44.962382 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-AttachVolumeShelveTestJSON-543397818-project Jun 23 22:47:44.962382 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: method: > Jun 23 22:47:44.962382 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: exception: Instance fe4cae6a-0365-477a-bbcb-100245e62715 could not be found. Jun 23 22:47:44.962382 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: action_args: {'id': 'fe4cae6a-0365-477a-bbcb-100245e62715'} Jun 23 22:47:44.963274 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:47:44.963274 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:47:44.963274 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:47:44.963274 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:47:44.963274 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:47:44.963274 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:47:44.963274 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:47:44.963274 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:47:44.963274 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:47:44.963274 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:47:44.963274 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe4cae6a-0365-477a-bbcb-100245e62715 could not be found. Jun 23 22:47:44.963274 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:47:44.963274 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:47:44.963274 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:47:44.963274 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:47:44.963274 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:47:44.963274 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:47:44.963274 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:47:44.963274 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:47:44.963274 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:47:44.964725 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:47:44.964725 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:47:44.964725 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:47:44.964725 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:47:44.964725 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:47:44.964725 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:47:44.964725 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:47:44.964725 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe4cae6a-0365-477a-bbcb-100245e62715 could not be found. Jun 23 22:47:44.964725 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:47:44.964725 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:47:44.964725 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:47:44.964725 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:47:44.964725 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:47:44.964725 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:47:44.964725 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:47:44.964725 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:47:44.964725 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe4cae6a-0365-477a-bbcb-100245e62715 could not be found. Jun 23 22:47:44.964725 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:47:44.966121 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-7d6c560b-c018-4b82-8434-1da8530e514a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Returning 404 to user: Instance fe4cae6a-0365-477a-bbcb-100245e62715 could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:47:44.966121 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-7d6c560b-c018-4b82-8434-1da8530e514a tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715" status: 404 len: 111 microversion: 2.20 time: 0.031970 Jun 23 22:47:44.966121 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 512/1048] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:47:44 2022] GET /compute/v2.1/servers/fe4cae6a-0365-477a-bbcb-100245e62715 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 22:47:46.075527 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [req-bc30e7ef-a0c6-46f6-ab12-69554047166a req-9ec0a07c-724b-443b-9b58-4c578c0937e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1d677cc-4aa2-43b3-802a-ef29bf811b24", "tag": "fdbb6199-e947-45ff-aadd-1b4eb33cf84b"}]} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:47:46.085223 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-bc30e7ef-a0c6-46f6-ab12-69554047166a req-9ec0a07c-724b-443b-9b58-4c578c0937e8 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:46.085889 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-bc30e7ef-a0c6-46f6-ab12-69554047166a req-9ec0a07c-724b-443b-9b58-4c578c0937e8 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:46.100956 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.compute.server_external_events [req-bc30e7ef-a0c6-46f6-ab12-69554047166a req-9ec0a07c-724b-443b-9b58-4c578c0937e8 service nova] Creating event network-changed:fdbb6199-e947-45ff-aadd-1b4eb33cf84b for instance e1d677cc-4aa2-43b3-802a-ef29bf811b24 on hv-cinder-84617 Jun 23 22:47:46.106461 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [req-bc30e7ef-a0c6-46f6-ab12-69554047166a req-9ec0a07c-724b-443b-9b58-4c578c0937e8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034453 Jun 23 22:47:46.107708 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 537/1049] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:47:46.116358 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-7c58dd2d-4135-4c58-8682-b16b54b63c02 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:46.117475 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-7c58dd2d-4135-4c58-8682-b16b54b63c02 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:46.123210 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell0:SELECT=2 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:47:46.125971 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7c58dd2d-4135-4c58-8682-b16b54b63c02 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:46.127634 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7c58dd2d-4135-4c58-8682-b16b54b63c02 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:46.128797 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7c58dd2d-4135-4c58-8682-b16b54b63c02 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:46.130336 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-7c58dd2d-4135-4c58-8682-b16b54b63c02 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:46.151615 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-7c58dd2d-4135-4c58-8682-b16b54b63c02 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] HTTP exception thrown: Instance 7b2f6937-650f-42b2-83cb-f2f54c40a6b3 could not be found. Jun 23 22:47:46.153180 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-7c58dd2d-4135-4c58-8682-b16b54b63c02 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Request method failure captured: Jun 23 22:47:46.153180 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: request: DELETE /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 HTTP/1.1 Jun 23 22:47:46.153180 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept: application/json Jun 23 22:47:46.153180 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Jun 23 22:47:46.153180 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Connection: close Jun 23 22:47:46.153180 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Length: 0 Jun 23 22:47:46.153180 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Type: application/json Jun 23 22:47:46.153180 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Host: 10.222.0.43 Jun 23 22:47:46.153180 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Jun 23 22:47:46.153180 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.9 Jun 23 22:47:46.153180 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABitOw0MOa6BWaAt76FiQb8wWjlkd6hLuW8KhNVqtFEeH7Vws1c7QV4QlDvvx1Ug-8Yn5zV2V6vcx0uASju7DUTyb3QJ1o8IVd5RMaIPwt_Hv-mRoZHqYWgBD-pTirG_gG7jFYX5SE0xzTE7P_w_QLEw6Zoh8UwLtYv-hyiNcCSTo9V-bM Jun 23 22:47:46.153180 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Jun 23 22:47:46.153180 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Jun 23 22:47:46.153180 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Jun 23 22:47:46.153180 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Jun 23 22:47:46.153180 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 22:47:46.153180 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Jun 23 22:47:46.153180 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Jun 23 22:47:46.153180 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Id: 9ab3a2e6c9634a06b33f1d82a28dc3f1 Jun 23 22:47:46.153180 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-543397818 Jun 23 22:47:46.153180 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Role: reader,member Jun 23 22:47:46.153180 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Roles: reader,member Jun 23 22:47:46.154714 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9ab3a2e6c9634a06b33f1d82a28dc3f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9ab3a2e6c9634a06b33f1d82a28dc3f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9ab3a2e6c9634a06b33f1d82a28dc3f1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9ab3a2e6c9634a06b33f1d82a28dc3f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:47:46.154714 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-AttachVolumeShelveTestJSON-543397818 Jun 23 22:47:46.154714 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Id: 9ab3a2e6c9634a06b33f1d82a28dc3f1 Jun 23 22:47:46.154714 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-543397818 Jun 23 22:47:46.154714 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User: tempest-AttachVolumeShelveTestJSON-543397818-project Jun 23 22:47:46.154714 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Jun 23 22:47:46.154714 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Jun 23 22:47:46.154714 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Id: 1a93ea9f0a3f47d68e53c464c1d52c92 Jun 23 22:47:46.154714 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-AttachVolumeShelveTestJSON-543397818-project Jun 23 22:47:46.154714 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: method: > Jun 23 22:47:46.154714 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: exception: Instance 7b2f6937-650f-42b2-83cb-f2f54c40a6b3 could not be found. Jun 23 22:47:46.154714 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: action_args: {'id': '7b2f6937-650f-42b2-83cb-f2f54c40a6b3'} Jun 23 22:47:46.155576 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:47:46.155576 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:47:46.155576 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:47:46.155576 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:47:46.155576 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:47:46.155576 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:47:46.155576 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:47:46.155576 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:47:46.155576 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:47:46.155576 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:47:46.155576 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b2f6937-650f-42b2-83cb-f2f54c40a6b3 could not be found. Jun 23 22:47:46.155576 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:47:46.155576 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:47:46.155576 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:47:46.155576 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:47:46.155576 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:47:46.155576 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:47:46.155576 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:47:46.155576 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:47:46.155576 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:47:46.156899 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:47:46.156899 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 22:47:46.156899 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 22:47:46.156899 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 22:47:46.156899 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 22:47:46.156899 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:47:46.156899 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:47:46.156899 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:47:46.156899 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:47:46.156899 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b2f6937-650f-42b2-83cb-f2f54c40a6b3 could not be found. Jun 23 22:47:46.156899 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:47:46.156899 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:47:46.156899 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:47:46.156899 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:47:46.156899 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:47:46.156899 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:47:46.156899 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:47:46.156899 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:47:46.156899 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b2f6937-650f-42b2-83cb-f2f54c40a6b3 could not be found. Jun 23 22:47:46.156899 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:47:46.158242 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-7c58dd2d-4135-4c58-8682-b16b54b63c02 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Returning 404 to user: Instance 7b2f6937-650f-42b2-83cb-f2f54c40a6b3 could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:47:46.158242 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-7c58dd2d-4135-4c58-8682-b16b54b63c02 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 404 len: 111 microversion: 2.20 time: 0.046545 Jun 23 22:47:46.158242 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 513/1050] 10.222.0.43 () {60 vars in 1279 bytes} [Thu Jun 23 22:47:46 2022] DELETE /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 23 22:47:46.169002 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-f506b539-3878-41e0-a80d-96328e42c851 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:46.169756 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-f506b539-3878-41e0-a80d-96328e42c851 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] [instance: 7b2f6937-650f-42b2-83cb-f2f54c40a6b3] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:46.177237 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f506b539-3878-41e0-a80d-96328e42c851 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:46.177871 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f506b539-3878-41e0-a80d-96328e42c851 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:46.178820 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f506b539-3878-41e0-a80d-96328e42c851 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:46.179355 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f506b539-3878-41e0-a80d-96328e42c851 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:46.195971 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.wsgi [None req-f506b539-3878-41e0-a80d-96328e42c851 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] HTTP exception thrown: Instance 7b2f6937-650f-42b2-83cb-f2f54c40a6b3 could not be found. Jun 23 22:47:46.198096 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-f506b539-3878-41e0-a80d-96328e42c851 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Request method failure captured: Jun 23 22:47:46.198096 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: request: GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 HTTP/1.1 Jun 23 22:47:46.198096 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept: application/json Jun 23 22:47:46.198096 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Accept-Encoding: identity Jun 23 22:47:46.198096 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Connection: close Jun 23 22:47:46.198096 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Length: 0 Jun 23 22:47:46.198096 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Content-Type: application/json Jun 23 22:47:46.198096 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Host: 10.222.0.43 Jun 23 22:47:46.198096 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Openstack-System-Scope: None Jun 23 22:47:46.198096 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: User-Agent: python-urllib3/1.26.9 Jun 23 22:47:46.198096 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Auth-Token: gAAAAABitOw0MOa6BWaAt76FiQb8wWjlkd6hLuW8KhNVqtFEeH7Vws1c7QV4QlDvvx1Ug-8Yn5zV2V6vcx0uASju7DUTyb3QJ1o8IVd5RMaIPwt_Hv-mRoZHqYWgBD-pTirG_gG7jFYX5SE0xzTE7P_w_QLEw6Zoh8UwLtYv-hyiNcCSTo9V-bM Jun 23 22:47:46.198096 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Id: None Jun 23 22:47:46.198096 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Domain-Name: None Jun 23 22:47:46.198096 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Identity-Status: Confirmed Jun 23 22:47:46.198096 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Is-Admin-Project: True Jun 23 22:47:46.198096 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 22:47:46.198096 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Id: default Jun 23 22:47:46.198096 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Domain-Name: Default Jun 23 22:47:46.198096 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Id: 9ab3a2e6c9634a06b33f1d82a28dc3f1 Jun 23 22:47:46.198096 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-543397818 Jun 23 22:47:46.198096 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Role: reader,member Jun 23 22:47:46.198096 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Roles: reader,member Jun 23 22:47:46.199882 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9ab3a2e6c9634a06b33f1d82a28dc3f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/9ab3a2e6c9634a06b33f1d82a28dc3f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_9ab3a2e6c9634a06b33f1d82a28dc3f1", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/9ab3a2e6c9634a06b33f1d82a28dc3f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:47:46.199882 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant: tempest-AttachVolumeShelveTestJSON-543397818 Jun 23 22:47:46.199882 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Id: 9ab3a2e6c9634a06b33f1d82a28dc3f1 Jun 23 22:47:46.199882 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-543397818 Jun 23 22:47:46.199882 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User: tempest-AttachVolumeShelveTestJSON-543397818-project Jun 23 22:47:46.199882 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Id: default Jun 23 22:47:46.199882 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Domain-Name: Default Jun 23 22:47:46.199882 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Id: 1a93ea9f0a3f47d68e53c464c1d52c92 Jun 23 22:47:46.199882 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: X-User-Name: tempest-AttachVolumeShelveTestJSON-543397818-project Jun 23 22:47:46.199882 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: method: > Jun 23 22:47:46.199882 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: exception: Instance 7b2f6937-650f-42b2-83cb-f2f54c40a6b3 could not be found. Jun 23 22:47:46.199882 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: action_args: {'id': '7b2f6937-650f-42b2-83cb-f2f54c40a6b3'} Jun 23 22:47:46.200772 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:47:46.200772 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:47:46.200772 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:47:46.200772 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:47:46.200772 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:47:46.200772 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:47:46.200772 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:47:46.200772 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:47:46.200772 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:47:46.200772 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:47:46.200772 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b2f6937-650f-42b2-83cb-f2f54c40a6b3 could not be found. Jun 23 22:47:46.200772 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:47:46.200772 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:47:46.200772 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:47:46.200772 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:47:46.200772 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:47:46.200772 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:47:46.200772 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:47:46.200772 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:47:46.200772 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:47:46.202306 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:47:46.202306 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:47:46.202306 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:47:46.202306 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:47:46.202306 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:47:46.202306 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:47:46.202306 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:47:46.202306 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b2f6937-650f-42b2-83cb-f2f54c40a6b3 could not be found. Jun 23 22:47:46.202306 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:47:46.202306 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:47:46.202306 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:47:46.202306 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:47:46.202306 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:47:46.202306 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:47:46.202306 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:47:46.202306 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:47:46.202306 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b2f6937-650f-42b2-83cb-f2f54c40a6b3 could not be found. Jun 23 22:47:46.202306 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: ERROR nova.api.openstack.wsgi Jun 23 22:47:46.203771 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-f506b539-3878-41e0-a80d-96328e42c851 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] Returning 404 to user: Instance 7b2f6937-650f-42b2-83cb-f2f54c40a6b3 could not be found. {{(pid=124357) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:47:46.203771 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-f506b539-3878-41e0-a80d-96328e42c851 tempest-AttachVolumeShelveTestJSON-543397818 tempest-AttachVolumeShelveTestJSON-543397818-project] 10.222.0.43 "GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3" status: 404 len: 111 microversion: 2.20 time: 0.036503 Jun 23 22:47:46.203771 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 538/1051] 10.222.0.43 () {60 vars in 1276 bytes} [Thu Jun 23 22:47:46 2022] GET /compute/v2.1/servers/7b2f6937-650f-42b2-83cb-f2f54c40a6b3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 22:47:47.592935 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-0cfa5562-2447-4b30-9f93-be3ee39af28c tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1008206565"}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:47:47.593522 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-0cfa5562-2447-4b30-9f93-be3ee39af28c tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:47.600601 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0cfa5562-2447-4b30-9f93-be3ee39af28c tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:47.601176 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0cfa5562-2447-4b30-9f93-be3ee39af28c tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:47.601886 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0cfa5562-2447-4b30-9f93-be3ee39af28c tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:47.602253 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-0cfa5562-2447-4b30-9f93-be3ee39af28c tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:47.740799 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.network.security_group_api [None req-0cfa5562-2447-4b30-9f93-be3ee39af28c tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Adding security group f3281fa8-3a82-460f-8fef-58b55888f631 to port fdbb6199-e947-45ff-aadd-1b4eb33cf84b Jun 23 22:47:48.124929 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-0cfa5562-2447-4b30-9f93-be3ee39af28c tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "POST /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24/action" status: 202 len: 0 microversion: 2.1 time: 0.532071 Jun 23 22:47:48.124929 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 514/1052] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Jun 23 22:47:47 2022] POST /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24/action => generated 0 bytes in 533 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:47:48.130329 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-98efe630-f0a8-4f4f-a70a-065100ae5b7f tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:48.131492 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-98efe630-f0a8-4f4f-a70a-065100ae5b7f tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:48.137700 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-9d890151-d496-4467-9f5b-d03da9aee785 req-0eda62b5-e1cf-4f01-89f3-6c58f07fccf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1d677cc-4aa2-43b3-802a-ef29bf811b24", "tag": "fdbb6199-e947-45ff-aadd-1b4eb33cf84b"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:47:48.145324 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-98efe630-f0a8-4f4f-a70a-065100ae5b7f tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:48.145779 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-98efe630-f0a8-4f4f-a70a-065100ae5b7f tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:48.146563 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-98efe630-f0a8-4f4f-a70a-065100ae5b7f tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:48.147038 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-98efe630-f0a8-4f4f-a70a-065100ae5b7f tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:48.151706 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-9d890151-d496-4467-9f5b-d03da9aee785 req-0eda62b5-e1cf-4f01-89f3-6c58f07fccf6 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:48.155197 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-9d890151-d496-4467-9f5b-d03da9aee785 req-0eda62b5-e1cf-4f01-89f3-6c58f07fccf6 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:48.176919 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-9d890151-d496-4467-9f5b-d03da9aee785 req-0eda62b5-e1cf-4f01-89f3-6c58f07fccf6 service nova] Creating event network-changed:fdbb6199-e947-45ff-aadd-1b4eb33cf84b for instance e1d677cc-4aa2-43b3-802a-ef29bf811b24 on hv-cinder-84617 Jun 23 22:47:48.192220 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-9d890151-d496-4467-9f5b-d03da9aee785 req-0eda62b5-e1cf-4f01-89f3-6c58f07fccf6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057863 Jun 23 22:47:48.197140 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 515/1053] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:47:48.477439 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-98efe630-f0a8-4f4f-a70a-065100ae5b7f tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6867c020bf2a4db3b0a4cebb32c64aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea45368b61d4748a164cc6b76293749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:48.488367 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-98efe630-f0a8-4f4f-a70a-065100ae5b7f tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24" status: 200 len: 1761 microversion: 2.1 time: 0.362053 Jun 23 22:47:48.489778 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 539/1054] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:48 2022] GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24 => generated 1761 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:53.057583 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 22:47:53.058038 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Thu Jun 23 22:47:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 22:48:10.820860 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=7 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:48:10.821603 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=20 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:48:10.825986 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-949eea75-cefb-44d9-a445-ba12827bf09d tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:48:10.827023 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-949eea75-cefb-44d9-a445-ba12827bf09d tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:10.833869 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-949eea75-cefb-44d9-a445-ba12827bf09d tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:10.834304 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-949eea75-cefb-44d9-a445-ba12827bf09d tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:10.835084 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-949eea75-cefb-44d9-a445-ba12827bf09d tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:10.835506 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-949eea75-cefb-44d9-a445-ba12827bf09d tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:10.907821 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-949eea75-cefb-44d9-a445-ba12827bf09d tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "POST /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24/action" status: 202 len: 0 microversion: 2.1 time: 0.087578 Jun 23 22:48:10.909067 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 516/1055] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Jun 23 22:48:10 2022] POST /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:48:10.917354 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-aca5cb4c-b72a-4afd-892b-e3fce0c16d3f tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:10.918301 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-aca5cb4c-b72a-4afd-892b-e3fce0c16d3f tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:10.920794 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:48:10.921456 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell1:SELECT=67 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:48:10.929755 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-aca5cb4c-b72a-4afd-892b-e3fce0c16d3f tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:10.930470 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-aca5cb4c-b72a-4afd-892b-e3fce0c16d3f tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:10.931382 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-aca5cb4c-b72a-4afd-892b-e3fce0c16d3f tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:10.931820 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-aca5cb4c-b72a-4afd-892b-e3fce0c16d3f tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:11.181574 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-aca5cb4c-b72a-4afd-892b-e3fce0c16d3f tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6867c020bf2a4db3b0a4cebb32c64aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea45368b61d4748a164cc6b76293749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:11.189790 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-aca5cb4c-b72a-4afd-892b-e3fce0c16d3f tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24" status: 200 len: 1753 microversion: 2.1 time: 0.276622 Jun 23 22:48:11.190355 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 540/1056] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:10 2022] GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24 => generated 1753 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:12.208515 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-22240bd2-c5ba-4653-93b0-72b5cdfb40b2 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:12.209234 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-22240bd2-c5ba-4653-93b0-72b5cdfb40b2 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:12.215499 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-22240bd2-c5ba-4653-93b0-72b5cdfb40b2 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:12.215947 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-22240bd2-c5ba-4653-93b0-72b5cdfb40b2 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:12.216751 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-22240bd2-c5ba-4653-93b0-72b5cdfb40b2 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:12.217187 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-22240bd2-c5ba-4653-93b0-72b5cdfb40b2 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:12.368802 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-22240bd2-c5ba-4653-93b0-72b5cdfb40b2 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6867c020bf2a4db3b0a4cebb32c64aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea45368b61d4748a164cc6b76293749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:12.376061 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-22240bd2-c5ba-4653-93b0-72b5cdfb40b2 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24" status: 200 len: 1758 microversion: 2.1 time: 0.171974 Jun 23 22:48:12.376647 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 517/1057] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:12 2022] GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24 => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:13.394093 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-40624bac-fdfb-4567-b835-ba8a5bada567 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:13.394616 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-40624bac-fdfb-4567-b835-ba8a5bada567 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:13.401172 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-40624bac-fdfb-4567-b835-ba8a5bada567 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:13.401675 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-40624bac-fdfb-4567-b835-ba8a5bada567 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:13.402463 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-40624bac-fdfb-4567-b835-ba8a5bada567 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:13.402895 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-40624bac-fdfb-4567-b835-ba8a5bada567 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:13.543626 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-40624bac-fdfb-4567-b835-ba8a5bada567 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6867c020bf2a4db3b0a4cebb32c64aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea45368b61d4748a164cc6b76293749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:13.551828 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-40624bac-fdfb-4567-b835-ba8a5bada567 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24" status: 200 len: 1758 microversion: 2.1 time: 0.162214 Jun 23 22:48:13.552384 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 541/1058] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:13 2022] GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24 => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:14.569016 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-e294cc07-9b33-4c01-8968-9f8c354af150 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:14.569618 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-e294cc07-9b33-4c01-8968-9f8c354af150 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:14.576013 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e294cc07-9b33-4c01-8968-9f8c354af150 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:14.576447 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e294cc07-9b33-4c01-8968-9f8c354af150 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:14.577192 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e294cc07-9b33-4c01-8968-9f8c354af150 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:14.577614 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-e294cc07-9b33-4c01-8968-9f8c354af150 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:14.717036 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-e294cc07-9b33-4c01-8968-9f8c354af150 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6867c020bf2a4db3b0a4cebb32c64aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea45368b61d4748a164cc6b76293749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:14.725111 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-e294cc07-9b33-4c01-8968-9f8c354af150 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24" status: 200 len: 1758 microversion: 2.1 time: 0.159946 Jun 23 22:48:14.725667 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 518/1059] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:14 2022] GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24 => generated 1758 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:15.742052 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-9bdfea8f-c7e6-4802-9a79-d6e13384bcea tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:15.742638 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-9bdfea8f-c7e6-4802-9a79-d6e13384bcea tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:15.749072 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9bdfea8f-c7e6-4802-9a79-d6e13384bcea tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:15.749509 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9bdfea8f-c7e6-4802-9a79-d6e13384bcea tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:15.751003 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9bdfea8f-c7e6-4802-9a79-d6e13384bcea tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:15.751441 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9bdfea8f-c7e6-4802-9a79-d6e13384bcea tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:15.894241 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-9bdfea8f-c7e6-4802-9a79-d6e13384bcea tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6867c020bf2a4db3b0a4cebb32c64aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea45368b61d4748a164cc6b76293749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:15.902448 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-9bdfea8f-c7e6-4802-9a79-d6e13384bcea tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24" status: 200 len: 1758 microversion: 2.1 time: 0.164459 Jun 23 22:48:15.903042 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 542/1060] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:15 2022] GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:16.920356 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-1711d2fb-ff78-4769-b405-8702bd59c84d tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:16.920925 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-1711d2fb-ff78-4769-b405-8702bd59c84d tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:16.927807 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1711d2fb-ff78-4769-b405-8702bd59c84d tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:16.928244 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1711d2fb-ff78-4769-b405-8702bd59c84d tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:16.928989 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1711d2fb-ff78-4769-b405-8702bd59c84d tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:16.929414 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-1711d2fb-ff78-4769-b405-8702bd59c84d tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:17.068343 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-1711d2fb-ff78-4769-b405-8702bd59c84d tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6867c020bf2a4db3b0a4cebb32c64aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea45368b61d4748a164cc6b76293749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:17.076577 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-1711d2fb-ff78-4769-b405-8702bd59c84d tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24" status: 200 len: 1758 microversion: 2.1 time: 0.160405 Jun 23 22:48:17.077132 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 519/1061] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:16 2022] GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24 => generated 1758 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:18.093593 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-f02bc479-262c-45b6-a390-89a85afa4f6d tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:18.094267 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-f02bc479-262c-45b6-a390-89a85afa4f6d tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:18.101456 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f02bc479-262c-45b6-a390-89a85afa4f6d tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:18.101901 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f02bc479-262c-45b6-a390-89a85afa4f6d tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:18.102708 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f02bc479-262c-45b6-a390-89a85afa4f6d tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:18.103176 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f02bc479-262c-45b6-a390-89a85afa4f6d tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:18.247850 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-f02bc479-262c-45b6-a390-89a85afa4f6d tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6867c020bf2a4db3b0a4cebb32c64aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea45368b61d4748a164cc6b76293749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:18.256308 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-f02bc479-262c-45b6-a390-89a85afa4f6d tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24" status: 200 len: 1758 microversion: 2.1 time: 0.166649 Jun 23 22:48:18.256877 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 543/1062] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:18 2022] GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24 => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:19.273810 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-989147cc-715d-45df-8f31-99f6447c0ffc tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:19.274419 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-989147cc-715d-45df-8f31-99f6447c0ffc tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:19.280904 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-989147cc-715d-45df-8f31-99f6447c0ffc tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:19.282015 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-989147cc-715d-45df-8f31-99f6447c0ffc tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:19.282783 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-989147cc-715d-45df-8f31-99f6447c0ffc tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:19.283258 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-989147cc-715d-45df-8f31-99f6447c0ffc tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:19.427239 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-989147cc-715d-45df-8f31-99f6447c0ffc tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6867c020bf2a4db3b0a4cebb32c64aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea45368b61d4748a164cc6b76293749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:19.435349 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-989147cc-715d-45df-8f31-99f6447c0ffc tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24" status: 200 len: 1758 microversion: 2.1 time: 0.165383 Jun 23 22:48:19.435909 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 520/1063] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:19 2022] GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:20.452583 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-5d54d852-f1a3-4f21-91ab-820093de8565 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:20.453199 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-5d54d852-f1a3-4f21-91ab-820093de8565 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:20.459628 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5d54d852-f1a3-4f21-91ab-820093de8565 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:20.460071 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5d54d852-f1a3-4f21-91ab-820093de8565 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:20.460827 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5d54d852-f1a3-4f21-91ab-820093de8565 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:20.461265 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5d54d852-f1a3-4f21-91ab-820093de8565 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:20.603820 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-5d54d852-f1a3-4f21-91ab-820093de8565 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6867c020bf2a4db3b0a4cebb32c64aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea45368b61d4748a164cc6b76293749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:20.612804 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-5d54d852-f1a3-4f21-91ab-820093de8565 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24" status: 200 len: 1758 microversion: 2.1 time: 0.164053 Jun 23 22:48:20.613375 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 544/1064] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:20 2022] GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24 => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:21.630403 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-9700b267-e0d5-447d-b1da-9f5f1f77496e tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:21.631034 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-9700b267-e0d5-447d-b1da-9f5f1f77496e tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:21.637622 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9700b267-e0d5-447d-b1da-9f5f1f77496e tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:21.638068 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9700b267-e0d5-447d-b1da-9f5f1f77496e tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:21.638827 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9700b267-e0d5-447d-b1da-9f5f1f77496e tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:21.639289 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-9700b267-e0d5-447d-b1da-9f5f1f77496e tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:21.782024 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-9700b267-e0d5-447d-b1da-9f5f1f77496e tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6867c020bf2a4db3b0a4cebb32c64aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea45368b61d4748a164cc6b76293749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:21.789949 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-9700b267-e0d5-447d-b1da-9f5f1f77496e tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24" status: 200 len: 1758 microversion: 2.1 time: 0.163436 Jun 23 22:48:21.790506 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 521/1065] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:21 2022] GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24 => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:22.807775 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-f1a11315-eaf8-4d71-b609-60e4acb180cd tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:22.808387 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-f1a11315-eaf8-4d71-b609-60e4acb180cd tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:22.815585 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f1a11315-eaf8-4d71-b609-60e4acb180cd tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:22.816033 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f1a11315-eaf8-4d71-b609-60e4acb180cd tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:22.816787 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f1a11315-eaf8-4d71-b609-60e4acb180cd tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:22.817220 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-f1a11315-eaf8-4d71-b609-60e4acb180cd tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:22.955662 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-f1a11315-eaf8-4d71-b609-60e4acb180cd tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6867c020bf2a4db3b0a4cebb32c64aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea45368b61d4748a164cc6b76293749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:22.963692 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-f1a11315-eaf8-4d71-b609-60e4acb180cd tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24" status: 200 len: 1761 microversion: 2.1 time: 0.159740 Jun 23 22:48:22.964281 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 545/1066] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:22 2022] GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24 => generated 1761 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:55.374934 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-de0651ea-d3b9-4982-b8e3-2cb335db4115 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1008206565"}} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:48:55.375542 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-de0651ea-d3b9-4982-b8e3-2cb335db4115 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:55.377675 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_api:SELECT=12 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:48:55.378341 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG dbcounter [-] [124358] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:48:55.384120 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-de0651ea-d3b9-4982-b8e3-2cb335db4115 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:55.384569 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-de0651ea-d3b9-4982-b8e3-2cb335db4115 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:55.385334 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-de0651ea-d3b9-4982-b8e3-2cb335db4115 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:55.385766 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-de0651ea-d3b9-4982-b8e3-2cb335db4115 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:55.514172 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.network.security_group_api [None req-de0651ea-d3b9-4982-b8e3-2cb335db4115 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Removing security group f3281fa8-3a82-460f-8fef-58b55888f631 from port fdbb6199-e947-45ff-aadd-1b4eb33cf84b Jun 23 22:48:55.847856 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-de0651ea-d3b9-4982-b8e3-2cb335db4115 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "POST /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24/action" status: 202 len: 0 microversion: 2.1 time: 0.476098 Jun 23 22:48:55.850204 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 522/1067] 10.222.0.43 () {60 vars in 1277 bytes} [Thu Jun 23 22:48:55 2022] POST /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24/action => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:48:55.861211 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [req-798e1833-8bb8-43af-b173-404d9e66be76 req-57a651ee-e2d6-4a6e-ae74-05f81c315dac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1d677cc-4aa2-43b3-802a-ef29bf811b24", "tag": "fdbb6199-e947-45ff-aadd-1b4eb33cf84b"}]} {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:48:55.882111 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_api:SELECT=12 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:48:55.882660 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG dbcounter [-] [124357] Writing DB stats nova_cell1:SELECT=36 {{(pid=124357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:48:55.888668 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-798e1833-8bb8-43af-b173-404d9e66be76 req-57a651ee-e2d6-4a6e-ae74-05f81c315dac service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:55.889334 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [req-798e1833-8bb8-43af-b173-404d9e66be76 req-57a651ee-e2d6-4a6e-ae74-05f81c315dac service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:55.918270 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.compute.server_external_events [req-798e1833-8bb8-43af-b173-404d9e66be76 req-57a651ee-e2d6-4a6e-ae74-05f81c315dac service nova] Creating event network-changed:fdbb6199-e947-45ff-aadd-1b4eb33cf84b for instance e1d677cc-4aa2-43b3-802a-ef29bf811b24 on hv-cinder-84617 Jun 23 22:48:55.923804 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [req-798e1833-8bb8-43af-b173-404d9e66be76 req-57a651ee-e2d6-4a6e-ae74-05f81c315dac service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074823 Jun 23 22:48:55.924695 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 546/1068] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:48:57.503487 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-2292193d-5113-472d-9e7f-8aef7eba69da tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:57.504085 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-2292193d-5113-472d-9e7f-8aef7eba69da tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:57.510193 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2292193d-5113-472d-9e7f-8aef7eba69da tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:57.510631 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2292193d-5113-472d-9e7f-8aef7eba69da tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:57.511420 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2292193d-5113-472d-9e7f-8aef7eba69da tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:57.511843 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-2292193d-5113-472d-9e7f-8aef7eba69da tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:57.592184 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.objects.instance [None req-2292193d-5113-472d-9e7f-8aef7eba69da tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lazy-loading 'services' on Instance uuid e1d677cc-4aa2-43b3-802a-ef29bf811b24 {{(pid=124358) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:48:57.664601 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-2292193d-5113-472d-9e7f-8aef7eba69da tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24/os-volume_attachments/c2733656-68ec-4796-a373-57e7ca88bfe3" status: 202 len: 0 microversion: 2.1 time: 0.166072 Jun 23 22:48:57.668517 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 523/1069] 10.222.0.43 () {58 vars in 1415 bytes} [Thu Jun 23 22:48:57 2022] DELETE /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24/os-volume_attachments/c2733656-68ec-4796-a373-57e7ca88bfe3 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:48:57.674576 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-26e8c987-de26-4604-a1a0-0b203b31ff28 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:57.675677 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-26e8c987-de26-4604-a1a0-0b203b31ff28 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:57.696730 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-26e8c987-de26-4604-a1a0-0b203b31ff28 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:57.697184 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-26e8c987-de26-4604-a1a0-0b203b31ff28 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:57.697977 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-26e8c987-de26-4604-a1a0-0b203b31ff28 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:57.698415 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-26e8c987-de26-4604-a1a0-0b203b31ff28 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:57.732589 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-26e8c987-de26-4604-a1a0-0b203b31ff28 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062271 Jun 23 22:48:57.733617 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 547/1070] 10.222.0.43 () {58 vars in 1301 bytes} [Thu Jun 23 22:48:57 2022] GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:48:57.938649 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-2543c478-22ea-4460-a9e6-5c2884545452 req-f169faf1-e2a0-444e-9c90-bc0ef2c74b46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1d677cc-4aa2-43b3-802a-ef29bf811b24", "tag": "fdbb6199-e947-45ff-aadd-1b4eb33cf84b"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:48:57.946964 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-2543c478-22ea-4460-a9e6-5c2884545452 req-f169faf1-e2a0-444e-9c90-bc0ef2c74b46 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:57.947411 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-2543c478-22ea-4460-a9e6-5c2884545452 req-f169faf1-e2a0-444e-9c90-bc0ef2c74b46 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:57.958487 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-2543c478-22ea-4460-a9e6-5c2884545452 req-f169faf1-e2a0-444e-9c90-bc0ef2c74b46 service nova] Creating event network-changed:fdbb6199-e947-45ff-aadd-1b4eb33cf84b for instance e1d677cc-4aa2-43b3-802a-ef29bf811b24 on hv-cinder-84617 Jun 23 22:48:57.963342 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-2543c478-22ea-4460-a9e6-5c2884545452 req-f169faf1-e2a0-444e-9c90-bc0ef2c74b46 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028734 Jun 23 22:48:57.963933 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 524/1071] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:48:58.745139 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-9ee23f5c-810c-4780-afb7-2bfeaa413bb1 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:58.746061 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-9ee23f5c-810c-4780-afb7-2bfeaa413bb1 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:58.752440 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9ee23f5c-810c-4780-afb7-2bfeaa413bb1 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:58.752913 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9ee23f5c-810c-4780-afb7-2bfeaa413bb1 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:58.753674 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9ee23f5c-810c-4780-afb7-2bfeaa413bb1 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:58.754106 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-9ee23f5c-810c-4780-afb7-2bfeaa413bb1 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:58.782532 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-9ee23f5c-810c-4780-afb7-2bfeaa413bb1 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041363 Jun 23 22:48:58.783105 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 548/1072] 10.222.0.43 () {58 vars in 1301 bytes} [Thu Jun 23 22:48:58 2022] GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 22:48:58.794133 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-549c06da-a7e2-40e6-899b-86a33b3d6211 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:58.794735 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-549c06da-a7e2-40e6-899b-86a33b3d6211 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:58.801396 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-549c06da-a7e2-40e6-899b-86a33b3d6211 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:58.801841 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-549c06da-a7e2-40e6-899b-86a33b3d6211 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:58.802594 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-549c06da-a7e2-40e6-899b-86a33b3d6211 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:58.803057 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-549c06da-a7e2-40e6-899b-86a33b3d6211 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:58.878124 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-549c06da-a7e2-40e6-899b-86a33b3d6211 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] HTTP exception thrown: Instance e1d677cc-4aa2-43b3-802a-ef29bf811b24 is not attached to volume c2733656-68ec-4796-a373-57e7ca88bfe3 Jun 23 22:48:58.880459 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-549c06da-a7e2-40e6-899b-86a33b3d6211 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Request method failure captured: Jun 23 22:48:58.880459 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: request: DELETE /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24/os-volume_attachments/c2733656-68ec-4796-a373-57e7ca88bfe3 HTTP/1.1 Jun 23 22:48:58.880459 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept: application/json Jun 23 22:48:58.880459 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Jun 23 22:48:58.880459 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Connection: close Jun 23 22:48:58.880459 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Length: 0 Jun 23 22:48:58.880459 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Type: application/json Jun 23 22:48:58.880459 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Host: 10.222.0.43 Jun 23 22:48:58.880459 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Jun 23 22:48:58.880459 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.9 Jun 23 22:48:58.880459 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABitO1fBmnPQIMDQNuhuT60l2ZgEFvJmNeHySAKL8RUcq3cMAtjrOTMb95Hp0M6FU4s8XSqZC7f63286_mDUULJI-JN2Basv6QWo6nAsTg8FEHhTMU8obTZ7jfMF0W1XDD5m7uUmC4dIW30ETiQf09P3bLcyWxRz66dSwYu-UL3V8w6_tM Jun 23 22:48:58.880459 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Jun 23 22:48:58.880459 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Jun 23 22:48:58.880459 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Jun 23 22:48:58.880459 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Jun 23 22:48:58.880459 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Jun 23 22:48:58.880459 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Jun 23 22:48:58.880459 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Id: cea45368b61d4748a164cc6b76293749 Jun 23 22:48:58.880459 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-TestMinimumBasicScenario-1760197661 Jun 23 22:48:58.880459 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Role: reader,member Jun 23 22:48:58.880459 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Roles: reader,member Jun 23 22:48:58.882271 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cea45368b61d4748a164cc6b76293749"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cea45368b61d4748a164cc6b76293749"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cea45368b61d4748a164cc6b76293749", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cea45368b61d4748a164cc6b76293749"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:48:58.882271 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-TestMinimumBasicScenario-1760197661 Jun 23 22:48:58.882271 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Id: cea45368b61d4748a164cc6b76293749 Jun 23 22:48:58.882271 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1760197661 Jun 23 22:48:58.882271 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User: tempest-TestMinimumBasicScenario-1760197661-project Jun 23 22:48:58.882271 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Jun 23 22:48:58.882271 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Jun 23 22:48:58.882271 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Id: 6867c020bf2a4db3b0a4cebb32c64aa3 Jun 23 22:48:58.882271 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-TestMinimumBasicScenario-1760197661-project Jun 23 22:48:58.882271 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: method: > Jun 23 22:48:58.882271 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: exception: Instance e1d677cc-4aa2-43b3-802a-ef29bf811b24 is not attached to volume c2733656-68ec-4796-a373-57e7ca88bfe3 Jun 23 22:48:58.883233 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: action_args: {'server_id': 'e1d677cc-4aa2-43b3-802a-ef29bf811b24', 'id': 'c2733656-68ec-4796-a373-57e7ca88bfe3'} Jun 23 22:48:58.883233 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:48:58.883233 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:48:58.883233 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 23 22:48:58.883233 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 23 22:48:58.883233 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 22:48:58.883233 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 22:48:58.883233 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 23 22:48:58.883233 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 23 22:48:58.883233 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c2733656-68ec-4796-a373-57e7ca88bfe3. Jun 23 22:48:58.883233 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:48:58.883233 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:48:58.883233 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:48:58.883233 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:48:58.883233 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:48:58.883233 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:48:58.883233 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:48:58.883233 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:48:58.883233 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:48:58.884782 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:48:58.884782 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 23 22:48:58.884782 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 23 22:48:58.884782 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1d677cc-4aa2-43b3-802a-ef29bf811b24 is not attached to volume c2733656-68ec-4796-a373-57e7ca88bfe3 Jun 23 22:48:58.884782 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:48:58.884782 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:48:58.884782 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:48:58.884782 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:48:58.884782 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:48:58.884782 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:48:58.884782 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:48:58.884782 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:48:58.884782 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1d677cc-4aa2-43b3-802a-ef29bf811b24 is not attached to volume c2733656-68ec-4796-a373-57e7ca88bfe3 Jun 23 22:48:58.884782 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:48:58.884782 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-549c06da-a7e2-40e6-899b-86a33b3d6211 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Returning 404 to user: Instance e1d677cc-4aa2-43b3-802a-ef29bf811b24 is not attached to volume c2733656-68ec-4796-a373-57e7ca88bfe3 {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:48:58.885959 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-549c06da-a7e2-40e6-899b-86a33b3d6211 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24/os-volume_attachments/c2733656-68ec-4796-a373-57e7ca88bfe3" status: 404 len: 154 microversion: 2.1 time: 0.092857 Jun 23 22:48:58.885959 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 525/1073] 10.222.0.43 () {58 vars in 1415 bytes} [Thu Jun 23 22:48:58 2022] DELETE /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24/os-volume_attachments/c2733656-68ec-4796-a373-57e7ca88bfe3 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:49:00.017557 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-469f25f6-fcb2-42bb-adb1-4dbb4fcc1fd2 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:00.018089 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-469f25f6-fcb2-42bb-adb1-4dbb4fcc1fd2 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:00.024409 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-469f25f6-fcb2-42bb-adb1-4dbb4fcc1fd2 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:00.024850 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-469f25f6-fcb2-42bb-adb1-4dbb4fcc1fd2 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:00.025598 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-469f25f6-fcb2-42bb-adb1-4dbb4fcc1fd2 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:00.026026 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-469f25f6-fcb2-42bb-adb1-4dbb4fcc1fd2 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:00.051452 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-469f25f6-fcb2-42bb-adb1-4dbb4fcc1fd2 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Going to try to terminate instance {{(pid=124357) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:49:00.125463 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-469f25f6-fcb2-42bb-adb1-4dbb4fcc1fd2 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "DELETE /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24" status: 204 len: 0 microversion: 2.1 time: 0.111857 Jun 23 22:49:00.126048 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 549/1074] 10.222.0.43 () {58 vars in 1238 bytes} [Thu Jun 23 22:49:00 2022] DELETE /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 22:49:00.134177 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-da358ae4-6814-4045-9ae3-17d3d745757b tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:00.134823 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-da358ae4-6814-4045-9ae3-17d3d745757b tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:00.142655 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-da358ae4-6814-4045-9ae3-17d3d745757b tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:00.143126 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-da358ae4-6814-4045-9ae3-17d3d745757b tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:00.143941 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-da358ae4-6814-4045-9ae3-17d3d745757b tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:00.145574 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-da358ae4-6814-4045-9ae3-17d3d745757b tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:00.273747 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.policy [None req-da358ae4-6814-4045-9ae3-17d3d745757b tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6867c020bf2a4db3b0a4cebb32c64aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea45368b61d4748a164cc6b76293749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124358) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:00.281774 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-da358ae4-6814-4045-9ae3-17d3d745757b tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24" status: 200 len: 1555 microversion: 2.1 time: 0.151346 Jun 23 22:49:00.282325 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 526/1075] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:00 2022] GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:49:01.299997 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-879ae541-7384-43bd-ab6f-1b355f8c72db tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:01.300696 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-879ae541-7384-43bd-ab6f-1b355f8c72db tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:01.307210 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-879ae541-7384-43bd-ab6f-1b355f8c72db tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:01.307663 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-879ae541-7384-43bd-ab6f-1b355f8c72db tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:01.308417 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-879ae541-7384-43bd-ab6f-1b355f8c72db tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:01.308847 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-879ae541-7384-43bd-ab6f-1b355f8c72db tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:01.434432 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-879ae541-7384-43bd-ab6f-1b355f8c72db tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6867c020bf2a4db3b0a4cebb32c64aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea45368b61d4748a164cc6b76293749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:01.445037 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-879ae541-7384-43bd-ab6f-1b355f8c72db tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24" status: 200 len: 1555 microversion: 2.1 time: 0.149380 Jun 23 22:49:01.445668 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 550/1076] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:01 2022] GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24 => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:02.392052 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [req-3fcce0e5-3109-45ce-8239-7e47698de3cb req-aa3bf26e-11d5-4e56-9b88-1b1bd87034d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1d677cc-4aa2-43b3-802a-ef29bf811b24", "name": "network-vif-deleted", "tag": "fdbb6199-e947-45ff-aadd-1b4eb33cf84b"}]} {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:49:02.403047 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-3fcce0e5-3109-45ce-8239-7e47698de3cb req-aa3bf26e-11d5-4e56-9b88-1b1bd87034d7 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:02.403488 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [req-3fcce0e5-3109-45ce-8239-7e47698de3cb req-aa3bf26e-11d5-4e56-9b88-1b1bd87034d7 service nova] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:02.417252 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.compute.server_external_events [req-3fcce0e5-3109-45ce-8239-7e47698de3cb req-aa3bf26e-11d5-4e56-9b88-1b1bd87034d7 service nova] Creating event network-vif-deleted:fdbb6199-e947-45ff-aadd-1b4eb33cf84b for instance e1d677cc-4aa2-43b3-802a-ef29bf811b24 on hv-cinder-84617 Jun 23 22:49:02.423061 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [req-3fcce0e5-3109-45ce-8239-7e47698de3cb req-aa3bf26e-11d5-4e56-9b88-1b1bd87034d7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034774 Jun 23 22:49:02.423659 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 527/1077] 10.222.0.43 () {64 vars in 1317 bytes} [Thu Jun 23 22:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:49:02.462582 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-5aeb4ef5-693a-4484-ae27-7c4a66664c66 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:02.463242 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.compute.api [None req-5aeb4ef5-693a-4484-ae27-7c4a66664c66 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124357) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:02.471154 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5aeb4ef5-693a-4484-ae27-7c4a66664c66 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:02.471604 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5aeb4ef5-693a-4484-ae27-7c4a66664c66 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:02.472380 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5aeb4ef5-693a-4484-ae27-7c4a66664c66 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:02.472808 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5aeb4ef5-693a-4484-ae27-7c4a66664c66 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:02.504067 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5aeb4ef5-693a-4484-ae27-7c4a66664c66 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:02.504514 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG oslo_concurrency.lockutils [None req-5aeb4ef5-693a-4484-ae27-7c4a66664c66 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124357) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:02.504966 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.objects.instance [None req-5aeb4ef5-693a-4484-ae27-7c4a66664c66 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lazy-loading 'fault' on Instance uuid e1d677cc-4aa2-43b3-802a-ef29bf811b24 {{(pid=124357) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:49:02.545292 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.policy [None req-5aeb4ef5-693a-4484-ae27-7c4a66664c66 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6867c020bf2a4db3b0a4cebb32c64aa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea45368b61d4748a164cc6b76293749', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124357) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:02.552860 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-5aeb4ef5-693a-4484-ae27-7c4a66664c66 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24" status: 200 len: 1349 microversion: 2.1 time: 0.094206 Jun 23 22:49:02.553423 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 551/1078] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:02 2022] GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24 => generated 1349 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:03.569897 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a2936d51-5ee0-4882-8ed3-11439bfe3463 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '>' {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:03.570625 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.compute.api [None req-a2936d51-5ee0-4882-8ed3-11439bfe3463 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] [instance: e1d677cc-4aa2-43b3-802a-ef29bf811b24] Fetching instance by UUID {{(pid=124358) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:03.577323 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a2936d51-5ee0-4882-8ed3-11439bfe3463 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:03.577761 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a2936d51-5ee0-4882-8ed3-11439bfe3463 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:03.579279 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a2936d51-5ee0-4882-8ed3-11439bfe3463 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:03.579884 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG oslo_concurrency.lockutils [None req-a2936d51-5ee0-4882-8ed3-11439bfe3463 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Lock "153e4b5e-85be-4e7e-b870-de4fc67764a6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124358) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:03.592748 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.wsgi [None req-a2936d51-5ee0-4882-8ed3-11439bfe3463 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] HTTP exception thrown: Instance e1d677cc-4aa2-43b3-802a-ef29bf811b24 could not be found. Jun 23 22:49:03.594408 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a2936d51-5ee0-4882-8ed3-11439bfe3463 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Request method failure captured: Jun 23 22:49:03.594408 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: request: GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24 HTTP/1.1 Jun 23 22:49:03.594408 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept: application/json Jun 23 22:49:03.594408 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Accept-Encoding: identity Jun 23 22:49:03.594408 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Connection: close Jun 23 22:49:03.594408 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Length: 0 Jun 23 22:49:03.594408 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Content-Type: application/json Jun 23 22:49:03.594408 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Host: 10.222.0.43 Jun 23 22:49:03.594408 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Openstack-System-Scope: None Jun 23 22:49:03.594408 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: User-Agent: python-urllib3/1.26.9 Jun 23 22:49:03.594408 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Auth-Token: gAAAAABitO1fBmnPQIMDQNuhuT60l2ZgEFvJmNeHySAKL8RUcq3cMAtjrOTMb95Hp0M6FU4s8XSqZC7f63286_mDUULJI-JN2Basv6QWo6nAsTg8FEHhTMU8obTZ7jfMF0W1XDD5m7uUmC4dIW30ETiQf09P3bLcyWxRz66dSwYu-UL3V8w6_tM Jun 23 22:49:03.594408 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Id: None Jun 23 22:49:03.594408 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Domain-Name: None Jun 23 22:49:03.594408 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Identity-Status: Confirmed Jun 23 22:49:03.594408 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Is-Admin-Project: True Jun 23 22:49:03.594408 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Id: default Jun 23 22:49:03.594408 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Domain-Name: Default Jun 23 22:49:03.594408 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Id: cea45368b61d4748a164cc6b76293749 Jun 23 22:49:03.594408 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Project-Name: tempest-TestMinimumBasicScenario-1760197661 Jun 23 22:49:03.594408 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Role: reader,member Jun 23 22:49:03.594408 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Roles: reader,member Jun 23 22:49:03.596098 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cea45368b61d4748a164cc6b76293749"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cea45368b61d4748a164cc6b76293749"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cea45368b61d4748a164cc6b76293749", "adminURL": "http://10.222.0.43:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cea45368b61d4748a164cc6b76293749"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}] Jun 23 22:49:03.596098 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant: tempest-TestMinimumBasicScenario-1760197661 Jun 23 22:49:03.596098 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Id: cea45368b61d4748a164cc6b76293749 Jun 23 22:49:03.596098 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1760197661 Jun 23 22:49:03.596098 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User: tempest-TestMinimumBasicScenario-1760197661-project Jun 23 22:49:03.596098 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Id: default Jun 23 22:49:03.596098 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Domain-Name: Default Jun 23 22:49:03.596098 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Id: 6867c020bf2a4db3b0a4cebb32c64aa3 Jun 23 22:49:03.596098 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: X-User-Name: tempest-TestMinimumBasicScenario-1760197661-project Jun 23 22:49:03.596098 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: method: > Jun 23 22:49:03.596098 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: exception: Instance e1d677cc-4aa2-43b3-802a-ef29bf811b24 could not be found. Jun 23 22:49:03.596098 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: action_args: {'id': 'e1d677cc-4aa2-43b3-802a-ef29bf811b24'} Jun 23 22:49:03.597216 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: {{(pid=124358) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:49:03.597216 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:49:03.597216 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:49:03.597216 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:49:03.597216 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:49:03.597216 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:49:03.597216 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:49:03.597216 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:49:03.597216 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:49:03.597216 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:49:03.597216 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1d677cc-4aa2-43b3-802a-ef29bf811b24 could not be found. Jun 23 22:49:03.597216 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:49:03.597216 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:49:03.597216 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:49:03.597216 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:49:03.597216 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:49:03.597216 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:49:03.597216 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:49:03.597216 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:49:03.597216 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:49:03.598883 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:49:03.598883 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:49:03.598883 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:49:03.598883 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:49:03.598883 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:49:03.598883 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:49:03.598883 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:49:03.598883 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1d677cc-4aa2-43b3-802a-ef29bf811b24 could not be found. Jun 23 22:49:03.598883 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:49:03.598883 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:49:03.598883 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:49:03.598883 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:49:03.598883 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:49:03.598883 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:49:03.598883 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:49:03.598883 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:49:03.598883 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1d677cc-4aa2-43b3-802a-ef29bf811b24 could not be found. Jun 23 22:49:03.598883 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: ERROR nova.api.openstack.wsgi Jun 23 22:49:03.600522 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: DEBUG nova.api.openstack.wsgi [None req-a2936d51-5ee0-4882-8ed3-11439bfe3463 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Returning 404 to user: Instance e1d677cc-4aa2-43b3-802a-ef29bf811b24 could not be found. {{(pid=124358) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:49:03.600522 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO nova.api.openstack.requestlog [None req-a2936d51-5ee0-4882-8ed3-11439bfe3463 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24" status: 404 len: 111 microversion: 2.1 time: 0.030164 Jun 23 22:49:03.600522 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: [pid: 124358|app: 0|req: 528/1079] 10.222.0.43 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:03 2022] GET /compute/v2.1/servers/e1d677cc-4aa2-43b3-802a-ef29bf811b24 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:49:03.604401 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: DEBUG nova.api.openstack.wsgi [None req-4523f666-afc9-4c28-bf27-a1b8e434d488 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] Calling method '.version_select at 0x7fb7195a8d30>' {{(pid=124357) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:03.621390 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO nova.api.openstack.requestlog [None req-4523f666-afc9-4c28-bf27-a1b8e434d488 tempest-TestMinimumBasicScenario-1760197661 tempest-TestMinimumBasicScenario-1760197661-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1726234061" status: 202 len: 0 microversion: 2.1 time: 0.020824 Jun 23 22:49:03.621924 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: [pid: 124357|app: 0|req: 552/1080] 10.222.0.43 () {58 vars in 1271 bytes} [Thu Jun 23 22:49:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1726234061 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:49:59.164255 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 22:49:59.164869 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Thu Jun 23 22:49:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 22:51:13.067124 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 22:51:13.067905 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Thu Jun 23 22:51:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 22:51:29.030244 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 22:51:29.030826 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Thu Jun 23 22:51:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 22:51:36.378560 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 22:51:36.379157 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Thu Jun 23 22:51:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 22:52:54.353898 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 22:52:54.354471 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Thu Jun 23 22:52:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 22:53:19.174593 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 22:53:19.175148 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Thu Jun 23 22:53:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 22:54:18.837400 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 22:54:18.837887 dv-cinder-846173-2-iscsi devstack@n-api.service[124357]: Thu Jun 23 22:54:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 22:54:33.075420 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 22:54:33.075970 dv-cinder-846173-2-iscsi devstack@n-api.service[124358]: Thu Jun 23 22:54:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!